Results for Open-Source LLM Models

The below captures the benchmark performance of the open-source models. Most of these were run through Ollama.ai on a consumer-grade laptop.

Please note that the below models vary in their "open-source-ness" (what has been actually released) and their licencing terms (what they can be used for). Be careful - some of the below models are for research purposes only (eg, Microsoft Phi).

Reminder: The below scores are on a scale 0-100, where 100 is the best possible score and 0 means the generated code was not even parseable.

# Imports
using JuliaLLMLeaderboard
using CairoMakie, AlgebraOfGraphics
using MarkdownTables, DataFramesMeta
using Statistics: mean, median, quantile;

# ! Configuration
SAVE_PLOTS = false
DIR_RESULTS = joinpath(pkgdir(JuliaLLMLeaderboard), "code_generation")
PAID_MODELS_DEFAULT = [
    "gpt-3.5-turbo",
    "gpt-3.5-turbo-1106",
    "gpt-4-1106-preview",
    "mistral-tiny",
    "mistral-small",
    "mistral-medium",
];
# TODO: add mapping for model sizes to color them
MODEL_SIZES = Dict()
PROMPTS = [
    "JuliaExpertCoTTask",
    "JuliaExpertAsk",
    "InJulia",
    "JuliaRecapTask",
    "JuliaRecapCoTTask",
];

Load Results

Use only the 5 most recent evaluations available for each definition/model/prompt

df = @chain begin
    load_evals(DIR_RESULTS; max_history = 5)
    @rsubset !any(startswith.(:model, PAID_MODELS_DEFAULT)) && :prompt_label in PROMPTS
end
5948×25 DataFrame
Rowdevicenamemodelprompt_labelprompt_strategyparsedexecutedunit_tests_counttimestampunit_tests_passedexperimentcostelapsed_secondsexamples_executedtokensversion_ptexamples_countversion_promptparametersschemafilenamescoretemperatureoptionstop_p
StringStringStringStringStringBoolBoolInt64StringInt64StringFloat64Float64Int64Array…StringInt64StringObject…StringStringFloat64Float64?Object…?Float64?
1Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruefalse420231213_230806__19300.08.654790[82, 255]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231213_230806__193.json25.0missingmissingmissing
2Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231224_215713__45300.016.58640[90, 299]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_215713__453.json50.0missing{\n "num_gpu": 99\n}missing
3Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231224_215726__57000.012.3390[90, 220]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_215726__570.json50.0missing{\n "num_gpu": 99\n}missing
4Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231226_205306__66200.016.67370[90, 302]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_205306__662.json50.0missing{\n "num_gpu": 99\n}missing
5Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231213_230757__38000.07.887540[112, 222]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231213_230757__380.json50.0missingmissingmissing
6Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231224_215643__49310.09.520423[129, 157]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_215643__493.json75.0missing{\n "num_gpu": 99\n}missing
7Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231224_215657__73600.012.87820[129, 220]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_215657__736.json50.0missing{\n "num_gpu": 99\n}missing
8Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231226_205249__83810.07.949841[129, 128]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_205249__838.json62.5missing{\n "num_gpu": 99\n}missing
9Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue420231213_230749__98400.022.77540[239, 589]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230749__984.json50.0missingmissingmissing
10Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse420231224_215629__13600.015.24460[257, 52]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215629__136.json0.0missing{\n "num_gpu": 99\n}missing
11Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse420231224_215634__38400.04.598770[257, 43]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215634__384.json0.0missing{\n "num_gpu": 99\n}missing
12Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse420231226_205241__76200.021.50780[257, 181]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205241__762.json0.0missing{\n "num_gpu": 99\n}missing
13Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue420231213_230900__25100.017.9320[11, 487]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230900__251.json50.0missingmissingmissing
14Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue420231224_215850__98310.020.5221[394, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215850__983.json62.5missing{\n "num_gpu": 99\n}missing
15Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse420231224_215919__85600.028.45540[394, 449]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215919__856.json0.0missing{\n "num_gpu": 99\n}missing
16Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue420231226_205426__53500.023.29390[394, 361]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205426__535.json50.0missing{\n "num_gpu": 99\n}missing
17Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTfalsefalse420231213_230842__93100.022.65440[383, 525]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231213_230842__931.json0.0missingmissingmissing
18Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTtruetrue420231224_215809__52500.018.10710[391, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_215809__525.json50.0missing{\n "num_gpu": 99\n}missing
19Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTtruetrue420231224_215830__70200.020.81760[391, 316]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_215830__702.json50.0missing{\n "num_gpu": 99\n}missing
20Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTtruetrue420231226_205402__39240.055.62994[391, 904]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_205402__392.json100.0missing{\n "num_gpu": 99\n}missing
21Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonInJulia1SHOTtruefalse420231213_230946__49600.017.02950[82, 499]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__InJulia__1SHOT__20231213_230946__496.json25.0missingmissingmissing
22Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonInJulia1SHOTfalsefalse420231224_220016__28600.012.5690[64, 230]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_220016__286.json0.0missing{\n "num_gpu": 99\n}missing
23Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonInJulia1SHOTfalsefalse420231224_220019__99000.03.500140[64, 57]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_220019__990.json0.0missing{\n "num_gpu": 99\n}missing
24Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse420231213_230929__13600.07.671150[112, 215]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231213_230929__136.json25.0missingmissingmissing
25Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse420231224_215950__86900.09.740120[66, 172]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_215950__869.json25.0missing{\n "num_gpu": 99\n}missing
26Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse420231224_220003__97500.013.28630[66, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_220003__975.json0.0missing{\n "num_gpu": 99\n}missing
27Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue420231213_230921__83400.020.61480[239, 530]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230921__834.json50.0missingmissingmissing
28Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse420231224_215937__26000.018.02860[132, 126]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215937__260.json0.0missing{\n "num_gpu": 99\n}missing
29Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse420231224_215940__81100.03.168630[132, 36]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215940__811.json0.0missing{\n "num_gpu": 99\n}missing
30Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue420231213_231040__28200.017.97120[11, 488]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231040__282.json50.0missingmissingmissing
31Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse420231224_220130__60200.01.382210[83, 11]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220130__602.json0.0missing{\n "num_gpu": 99\n}missing
32Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse420231224_220132__81900.02.633890[83, 35]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220132__819.json0.0missing{\n "num_gpu": 99\n}missing
33Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse420231213_231022__28900.022.2880[383, 515]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231213_231022__289.json0.0missingmissingmissing
34Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse420231224_220118__21600.03.197810[80, 46]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_220118__216.json0.0missing{\n "num_gpu": 99\n}missing
35Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse420231224_220128__84900.010.86130[80, 193]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_220128__849.json0.0missing{\n "num_gpu": 99\n}missing
36Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse420231219_205930__89600.012.93290[1, 399]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_205930__896.json25.0missingmissingmissing
37Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse420231219_205938__98900.08.490010[1, 260]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_205938__989.json25.0missingmissingmissing
38Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_222301__33200.050.05360[83, 287]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_222301__332.json50.0missing{\n "num_gpu": 99\n}missing
39Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_222342__55200.039.27430[83, 229]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_222342__552.json50.0missing{\n "num_gpu": 99\n}missing
40Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue420231226_210403__14600.032.36360[83, 191]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_210403__146.json50.0missing{\n "num_gpu": 99\n}missing
41Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_205855__89000.07.412820[1, 233]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_205855__890.json25.0missingmissingmissing
42Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231219_205901__34000.05.45590[1, 172]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_205901__340.json0.0missingmissingmissing
43Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_222043__59300.037.08560[124, 193]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222043__593.json0.0missing{\n "num_gpu": 99\n}missing
44Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_222211__90300.088.17910[124, 482]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222211__903.json0.0missing{\n "num_gpu": 99\n}missing
45Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231226_210331__53700.046.31060[124, 272]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_210331__537.json0.0missing{\n "num_gpu": 99\n}missing
46Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_205826__21100.014.19750[1, 401]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_205826__211.json25.0missingmissingmissing
47Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_205837__77300.011.48110[1, 340]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_205837__773.json25.0missingmissingmissing
48Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_221918__36140.080.96474[252, 222]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_221918__361.json100.0missing{\n "num_gpu": 99\n}missing
49Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_222005__40940.046.5834[252, 217]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_222005__409.json100.0missing{\n "num_gpu": 99\n}missing
50Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231226_210244__14840.077.30584[252, 283]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_210244__148.json100.0missing{\n "num_gpu": 99\n}missing
51Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_210157__12800.020.0670[1, 549]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210157__128.json25.0missingmissingmissing
52Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231219_210215__79000.018.19180[1, 501]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210215__790.json0.0missingmissingmissing
53Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_222805__50740.080.81564[412, 425]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_222805__507.json100.0missing{\n "num_gpu": 99\n}missing
54Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_222824__70610.019.52093[412, 58]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_222824__706.json75.0missing{\n "num_gpu": 99\n}missing
55Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231226_210644__75540.056.80964[412, 285]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210644__755.json100.0missing{\n "num_gpu": 99\n}missing
56Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_210059__80900.017.70740[1, 489]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210059__809.json25.0missingmissingmissing
57Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_210122__43900.022.22710[1, 603]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210122__439.json25.0missingmissingmissing
58Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_222548__55200.032.33840[410, 135]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_222548__552.json50.0missing{\n "num_gpu": 99\n}missing
59Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_222643__36300.054.11940[410, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_222643__363.json50.0missing{\n "num_gpu": 99\n}missing
60Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_210547__58900.0103.0520[410, 559]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_210547__589.json50.0missing{\n "num_gpu": 99\n}missing
61Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse420231226_211452__88300.05.420720[85, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_211452__883.json0.0missing{\n "num_gpu": 99\n}missing
62Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse420231227_095541__98600.013.5610[85, 516]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_095541__986.json25.0missing{\n "num_gpu": 99\n}missing
63Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse420231227_095551__78000.09.781930[85, 375]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_095551__780.json25.0missing{\n "num_gpu": 99\n}missing
64Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue420231227_095559__84800.08.360180[85, 321]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_095559__848.json50.0missing{\n "num_gpu": 99\n}missing
65Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue420231226_211446__83400.01.899110[122, 63]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_211446__834.json50.0missing{\n "num_gpu": 99\n}missing
66Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue420231227_095522__55900.07.512610[122, 283]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_095522__559.json50.0missing{\n "num_gpu": 99\n}missing
67Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue420231227_095526__19400.04.21420[122, 155]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_095526__194.json50.0missing{\n "num_gpu": 99\n}missing
68Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse420231227_095527__79700.01.56310[122, 49]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_095527__797.json0.0missing{\n "num_gpu": 99\n}missing
69Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue420231226_211444__67900.010.45010[234, 246]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211444__679.json50.0missing{\n "num_gpu": 99\n}missing
70Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231227_095458__90600.09.449090[234, 212]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095458__906.json0.0missing{\n "num_gpu": 99\n}missing
71Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue420231227_095508__39100.010.02840[234, 356]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095508__391.json50.0missing{\n "num_gpu": 99\n}missing
72Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse420231227_095514__17300.06.263060[234, 215]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095514__173.json25.0missing{\n "num_gpu": 99\n}missing
73Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231226_211518__80400.013.90770[374, 465]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211518__804.json0.0missing{\n "num_gpu": 99\n}missing
74Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231227_095631__15200.010.69410[374, 352]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095631__152.json0.0missing{\n "num_gpu": 99\n}missing
75Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_095636__47800.04.921650[374, 141]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095636__478.json50.0missing{\n "num_gpu": 99\n}missing
76Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_095646__35500.010.73560[374, 353]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095646__355.json50.0missing{\n "num_gpu": 99\n}missing
77Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse420231226_211504__64800.012.23950[371, 407]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_211504__648.json0.0missing{\n "num_gpu": 99\n}missing
78Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse420231227_095606__40500.06.970450[371, 217]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_095606__405.json0.0missing{\n "num_gpu": 99\n}missing
79Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue420231227_095613__19400.06.771640[371, 210]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_095613__194.json50.0missing{\n "num_gpu": 99\n}missing
80Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse420231227_095620__39000.06.743540[371, 209]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_095620__390.json25.0missing{\n "num_gpu": 99\n}missing
81Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruefalse420231224_214015__49600.07.848190[82, 232]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231224_214015__496.json25.0missing{\n "num_gpu": 99\n}missing
82Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruefalse420231224_214035__18300.019.70870[1, 589]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231224_214035__183.json25.0missing{\n "num_gpu": 99\n}missing
83Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruefalse420231226_203505__27900.017.05460[82, 502]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231226_203505__279.json25.0missing{\n "num_gpu": 99\n}missing
84Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruefalse420231226_203516__28100.010.52210[1, 324]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231226_203516__281.json25.0missing{\n "num_gpu": 99\n}missing
85Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruefalse420231226_204455__22300.032.66980[82, 909]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231226_204455__223.json25.0missing{\n "num_gpu": 99\n}missing
86Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231224_213957__49700.09.377550[112, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_213957__497.json50.0missing{\n "num_gpu": 99\n}missing
87Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruefalse420231224_214007__22600.08.226320[1, 253]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_214007__226.json25.0missing{\n "num_gpu": 99\n}missing
88Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231226_203439__91600.07.461960[112, 209]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_203439__916.json50.0missing{\n "num_gpu": 99\n}missing
89Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruefalse420231226_203448__72800.09.344180[1, 289]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_203448__728.json25.0missing{\n "num_gpu": 99\n}missing
90Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231226_204422__11100.06.615630[112, 181]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_204422__111.json50.0missing{\n "num_gpu": 99\n}missing
91Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTfalsefalse420231224_213929__41300.022.65260[257, 348]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_213929__413.json0.0missing{\n "num_gpu": 99\n}missing
92Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTtruefalse420231224_213947__37800.017.31610[1, 493]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_213947__378.json25.0missing{\n "num_gpu": 99\n}missing
93Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTtruefalse420231226_203420__90200.020.01840[257, 366]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_203420__902.json25.0missing{\n "num_gpu": 99\n}missing
94Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTfalsefalse420231226_203431__63800.011.55760[1, 339]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_203431__638.json0.0missing{\n "num_gpu": 99\n}missing
95Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTtruetrue420231226_204414__83200.023.94620[257, 395]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204414__832.json50.0missing{\n "num_gpu": 99\n}missing
96Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTtruetrue420231213_230308__13200.014.07840[11, 382]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230308__132.json50.0missingmissingmissing
97Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTfalsefalse420231224_214151__94400.016.17890[11, 442]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214151__944.json0.0missing{\n "num_gpu": 99\n}missing
98Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTtruetrue420231224_214220__27900.029.37450[1, 774]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214220__279.json50.0missing{\n "num_gpu": 99\n}missing
99Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTfalsefalse420231226_203647__52800.019.1070[11, 519]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_203647__528.json0.0missing{\n "num_gpu": 99\n}missing
100Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTtruetrue420231226_204536__90000.018.1730[11, 497]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_204536__900.json50.0missing{\n "num_gpu": 99\n}missing
101Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTtruefalse420231224_214121__10500.017.3190[383, 387]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_214121__105.json25.0missing{\n "num_gpu": 99\n}missing
102Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTtruetrue420231224_214135__48900.013.75190[1, 385]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_214135__489.json50.0missing{\n "num_gpu": 99\n}missing
103Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTtruetrue420231226_203603__89000.023.7460[383, 554]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_203603__890.json50.0missing{\n "num_gpu": 99\n}missing
104Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTfalsefalse420231226_203627__97600.024.18530[1, 651]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_203627__976.json0.0missing{\n "num_gpu": 99\n}missing
105Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTfalsefalse420231226_204517__69000.022.28870[383, 513]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_204517__690.json0.0missing{\n "num_gpu": 99\n}missing
106Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTfalsefalse420231213_231126__92000.014.85930[82, 437]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231213_231126__920.json0.0missingmissingmissing
107Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTtruetrue420231224_220223__78200.011.02840[82, 360]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231224_220223__782.json50.0missing{\n "num_gpu": 99\n}missing
108Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTtruetrue420231224_220229__21800.05.769610[82, 183]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231224_220229__218.json50.0missing{\n "num_gpu": 99\n}missing
109Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTtruetrue420231226_205457__29000.06.936980[82, 224]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231226_205457__290.json50.0missing{\n "num_gpu": 99\n}missing
110Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruetrue420231213_231111__16800.09.175010[112, 260]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231213_231111__168.json50.0missingmissingmissing
111Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruetrue420231224_220207__67100.07.378780[122, 232]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_220207__671.json50.0missing{\n "num_gpu": 99\n}missing
112Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruetrue420231224_220212__56900.04.67550[122, 141]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_220212__569.json50.0missing{\n "num_gpu": 99\n}missing
113Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruefalse420231226_205450__20400.08.694680[122, 277]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_205450__204.json25.0missing{\n "num_gpu": 99\n}missing
114Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTtruefalse420231213_231102__24600.021.76430[239, 563]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231102__246.json25.0missingmissingmissing
115Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTtruefalse420231224_220149__42800.016.52620[249, 313]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220149__428.json25.0missing{\n "num_gpu": 99\n}missing
116Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTtruetrue420231224_220159__58200.010.39470[249, 308]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220159__582.json50.0missing{\n "num_gpu": 99\n}missing
117Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTfalsefalse420231226_205441__85300.015.22130[249, 277]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205441__853.json0.0missing{\n "num_gpu": 99\n}missing
118Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231213_231216__15400.020.03060[11, 540]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231216__154.json50.0missingmissingmissing
119Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231224_220311__47100.011.09450[386, 302]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220311__471.json50.0missing{\n "num_gpu": 99\n}missing
120Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231224_220324__27700.012.18120[386, 336]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220324__277.json50.0missing{\n "num_gpu": 99\n}missing
121Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231226_205513__19400.010.0790[386, 271]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205513__194.json50.0missing{\n "num_gpu": 99\n}missing
122Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruetrue420231213_231156__78800.018.16150[383, 410]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231213_231156__788.json50.0missingmissingmissing
123Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruefalse420231224_220251__37900.08.740370[383, 232]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_220251__379.json25.0missing{\n "num_gpu": 99\n}missing
124Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruetrue420231224_220300__97700.09.061960[383, 242]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_220300__977.json50.0missing{\n "num_gpu": 99\n}missing
125Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruetrue420231226_205503__69500.05.896350[383, 141]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_205503__695.json50.0missing{\n "num_gpu": 99\n}missing
126Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue420231227_174325__52700.011.92710[82, 223]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174325__527.json50.0missing{\n "num_gpu": 99\n}missing
127Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue420231227_174339__42400.014.39410[82, 276]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174339__424.json50.0missing{\n "num_gpu": 99\n}missing
128Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue420231227_174354__56400.014.44030[82, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174354__564.json50.0missing{\n "num_gpu": 99\n}missing
129Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue420231227_174254__94100.010.65990[122, 199]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174254__941.json50.0missing{\n "num_gpu": 99\n}missing
130Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue420231227_174303__58900.08.876120[122, 163]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174303__589.json50.0missing{\n "num_gpu": 99\n}missing
131Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue420231227_174313__32800.09.567520[122, 173]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174313__328.json50.0missing{\n "num_gpu": 99\n}missing
132Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue420231227_174205__93400.021.97070[249, 262]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174205__934.json50.0missing{\n "num_gpu": 99\n}missing
133Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse420231227_174226__54700.020.74350[249, 376]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174226__547.json25.0missing{\n "num_gpu": 99\n}missing
134Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse420231227_174243__10700.017.52980[249, 318]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174243__107.json25.0missing{\n "num_gpu": 99\n}missing
135Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_174442__73000.014.36440[386, 237]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174442__730.json50.0missing{\n "num_gpu": 99\n}missing
136Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_174454__80600.012.21360[386, 196]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174454__806.json50.0missing{\n "num_gpu": 99\n}missing
137Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_174510__98700.016.22360[386, 252]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174510__987.json50.0missing{\n "num_gpu": 99\n}missing
138Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue420231227_174406__57100.012.29340[383, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174406__571.json50.0missing{\n "num_gpu": 99\n}missing
139Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue420231227_174416__96900.09.196560[383, 139]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174416__969.json50.0missing{\n "num_gpu": 99\n}missing
140Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue420231227_174427__51400.011.46430[383, 180]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174427__514.json50.0missing{\n "num_gpu": 99\n}missing
141Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse420231219_210835__10000.017.06240[1, 518]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_210835__100.json25.0missingmissingmissing
142Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse420231219_210845__98900.09.959850[1, 313]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_210845__989.json25.0missingmissingmissing
143Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse420231224_223313__64300.04.22270[79, 98]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_223313__643.json25.0missing{\n "num_gpu": 99\n}missing
144Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_223315__98800.02.138130[79, 43]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_223315__988.json50.0missing{\n "num_gpu": 99\n}missing
145Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue420231226_210906__34700.05.068740[79, 120]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_210906__347.json50.0missing{\n "num_gpu": 99\n}missing
146Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_210754__27500.08.080970[1, 253]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210754__275.json25.0missingmissingmissing
147Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_210803__58200.08.467450[1, 265]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210803__582.json25.0missingmissingmissing
148Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_223303__39400.03.46280[121, 73]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223303__394.json0.0missing{\n "num_gpu": 99\n}missing
149Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420231224_223308__84300.05.148640[121, 117]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223308__843.json50.0missing{\n "num_gpu": 99\n}missing
150Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231226_210901__26900.02.931790[121, 59]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_210901__269.json0.0missing{\n "num_gpu": 99\n}missing
151Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_210716__68200.012.29020[1, 362]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210716__682.json25.0missingmissingmissing
152Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_210737__39500.020.77730[1, 589]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210737__395.json25.0missingmissingmissing
153Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231224_223243__92700.022.73120[248, 403]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223243__927.json0.0missing{\n "num_gpu": 99\n}missing
154Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_223300__34400.017.15180[248, 403]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223300__344.json50.0missing{\n "num_gpu": 99\n}missing
155Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231226_210858__50200.023.09420[248, 417]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_210858__502.json25.0missing{\n "num_gpu": 99\n}missing
156Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_211104__52600.022.29040[1, 604]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211104__526.json25.0missingmissingmissing
157Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_211126__44800.022.05550[1, 598]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211126__448.json25.0missingmissingmissing
158Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223403__29900.010.08770[388, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223403__299.json50.0missing{\n "num_gpu": 99\n}missing
159Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223422__81500.019.82350[388, 442]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223422__815.json50.0missing{\n "num_gpu": 99\n}missing
160Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231226_210941__28900.019.19320[388, 426]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210941__289.json0.0missing{\n "num_gpu": 99\n}missing
161Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_211003__57300.020.91960[1, 570]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211003__573.json25.0missingmissingmissing
162Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_211021__69800.017.93650[1, 495]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211021__698.json25.0missingmissingmissing
163Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231224_223342__90700.012.71210[386, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223342__907.json25.0missing{\n "num_gpu": 99\n}missing
164Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_223352__87600.010.70430[386, 217]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223352__876.json50.0missing{\n "num_gpu": 99\n}missing
165Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_210922__80400.015.30310[386, 331]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_210922__804.json50.0missing{\n "num_gpu": 99\n}missing
166Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue420231227_222026__91400.016.070[78, 472]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222026__914.json50.0missing{\n "num_gpu": 99\n}missing
167Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse420231227_222038__66300.011.59740[78, 337]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222038__663.json25.0missing{\n "num_gpu": 99\n}missing
168Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue420231227_222054__86800.015.3460[78, 450]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222054__868.json50.0missing{\n "num_gpu": 99\n}missing
169Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue420231227_222111__32210.017.16714[78, 506]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222111__322.json81.25missing{\n "num_gpu": 99\n}missing
170Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse420231227_222126__89600.014.9960[78, 444]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222126__896.json25.0missing{\n "num_gpu": 99\n}missing
171Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_221944__54200.05.809320[120, 170]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_221944__542.json0.0missing{\n "num_gpu": 99\n}missing
172Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_221950__30200.05.801340[120, 162]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_221950__302.json0.0missing{\n "num_gpu": 99\n}missing
173Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue420231227_221957__82600.06.683580[120, 190]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_221957__826.json50.0missing{\n "num_gpu": 99\n}missing
174Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_222002__84300.05.214870[120, 147]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_222002__843.json0.0missing{\n "num_gpu": 99\n}missing
175Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_222010__18400.08.176280[120, 229]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_222010__184.json0.0missing{\n "num_gpu": 99\n}missing
176Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse420231227_221828__50100.015.85880[247, 282]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221828__501.json25.0missing{\n "num_gpu": 99\n}missing
177Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue420231227_221851__97000.022.77240[247, 671]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221851__970.json50.0missing{\n "num_gpu": 99\n}missing
178Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue420231227_221906__85400.014.16240[247, 411]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221906__854.json50.0missing{\n "num_gpu": 99\n}missing
179Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse420231227_221917__23000.010.94610[247, 310]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221917__230.json25.0missing{\n "num_gpu": 99\n}missing
180Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue420231227_221938__42110.021.51884[247, 628]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221938__421.json81.25missing{\n "num_gpu": 99\n}missing
181Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue420231227_222348__46710.032.31771[387, 887]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222348__467.json62.5missing{\n "num_gpu": 99\n}missing
182Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue420231227_222400__44000.011.38980[387, 298]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222400__440.json50.0missing{\n "num_gpu": 99\n}missing
183Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse420231227_222415__65100.014.86020[387, 396]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222415__651.json0.0missing{\n "num_gpu": 99\n}missing
184Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse420231227_222427__36400.012.48230[387, 320]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222427__364.json0.0missing{\n "num_gpu": 99\n}missing
185Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse420231227_222440__89500.012.31220[387, 316]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222440__895.json0.0missing{\n "num_gpu": 99\n}missing
186Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue420231227_222152__48200.025.63240[385, 687]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222152__482.json50.0missing{\n "num_gpu": 99\n}missing
187Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse420231227_222217__23000.025.18690[385, 676]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222217__230.json25.0missing{\n "num_gpu": 99\n}missing
188Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue420231227_222240__25100.022.88270[385, 616]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222240__251.json50.0missing{\n "num_gpu": 99\n}missing
189Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse420231227_222259__44400.018.79280[385, 502]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222259__444.json25.0missing{\n "num_gpu": 99\n}missing
190Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue420231227_222315__86600.016.25740[385, 422]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222315__866.json50.0missing{\n "num_gpu": 99\n}missing
191Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse420231227_222725__92300.024.56150[78, 606]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222725__923.json0.0missing{\n "num_gpu": 99\n}missing
192Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue420231227_222742__18700.016.98180[78, 425]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222742__187.json50.0missing{\n "num_gpu": 99\n}missing
193Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue420231227_222753__39200.010.8630[78, 269]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222753__392.json50.0missing{\n "num_gpu": 99\n}missing
194Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue420231227_222812__30800.018.61860[78, 466]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222812__308.json50.0missing{\n "num_gpu": 99\n}missing
195Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse420231227_222823__36200.010.70150[78, 265]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222823__362.json25.0missing{\n "num_gpu": 99\n}missing
196Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222627__30600.08.628020[120, 204]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222627__306.json50.0missing{\n "num_gpu": 99\n}missing
197Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222633__64210.05.974851[120, 136]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222633__642.json62.5missing{\n "num_gpu": 99\n}missing
198Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222642__97300.07.440110[120, 171]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222642__973.json50.0missing{\n "num_gpu": 99\n}missing
199Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222649__35900.07.059340[120, 164]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222649__359.json50.0missing{\n "num_gpu": 99\n}missing
200Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222700__37200.011.2880[120, 272]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222700__372.json50.0missing{\n "num_gpu": 99\n}missing
201Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222514__18900.034.53220[247, 689]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222514__189.json50.0missing{\n "num_gpu": 99\n}missing
202Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222531__74100.016.96640[247, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222531__741.json50.0missing{\n "num_gpu": 99\n}missing
203Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222554__40300.022.01290[247, 515]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222554__403.json50.0missing{\n "num_gpu": 99\n}missing
204Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231227_222605__24900.011.51670[247, 257]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222605__249.json0.0missing{\n "num_gpu": 99\n}missing
205Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222618__69200.012.48480[247, 281]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222618__692.json50.0missing{\n "num_gpu": 99\n}missing
206Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231227_223106__19700.024.42110[387, 550]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223106__197.json0.0missing{\n "num_gpu": 99\n}missing
207Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223116__63000.010.08630[387, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223116__630.json50.0missing{\n "num_gpu": 99\n}missing
208Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223148__19400.031.79650[387, 724]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223148__194.json50.0missing{\n "num_gpu": 99\n}missing
209Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223213__31800.024.80270[387, 559]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223213__318.json50.0missing{\n "num_gpu": 99\n}missing
210Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223239__95200.025.51920[387, 576]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223239__952.json50.0missing{\n "num_gpu": 99\n}missing
211Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse420231227_222852__56200.029.10680[385, 661]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_222852__562.json25.0missing{\n "num_gpu": 99\n}missing
212Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_222918__10800.026.29440[385, 595]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_222918__108.json50.0missing{\n "num_gpu": 99\n}missing
213Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_222945__68110.026.85972[385, 608]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_222945__681.json68.75missing{\n "num_gpu": 99\n}missing
214Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_223017__12800.031.43531[385, 716]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_223017__128.json56.25missing{\n "num_gpu": 99\n}missing
215Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse420231227_223042__33000.024.39460[385, 549]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_223042__330.json25.0missing{\n "num_gpu": 99\n}missing
216Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse420231226_115349__33900.032.22540[78, 584]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115349__339.json25.0missing{\n "num_gpu": 99\n}missing
217Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue420231226_115411__68400.021.93770[78, 401]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115411__684.json50.0missing{\n "num_gpu": 99\n}missing
218Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse420231226_211310__75000.024.35640[78, 448]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_211310__750.json25.0missing{\n "num_gpu": 99\n}missing
219Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue420231226_115305__77900.04.334530[120, 67]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115305__779.json50.0missing{\n "num_gpu": 99\n}missing
220Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse420231226_115316__94100.011.3130[120, 196]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115316__941.json0.0missing{\n "num_gpu": 99\n}missing
221Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse420231226_211246__29700.017.58960[120, 318]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_211246__297.json0.0missing{\n "num_gpu": 99\n}missing
222Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue420231226_115225__91800.034.55110[247, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115225__918.json50.0missing{\n "num_gpu": 99\n}missing
223Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue420231226_115300__23100.032.39573[247, 557]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115300__231.json68.75missing{\n "num_gpu": 99\n}missing
224Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231226_211228__84500.028.71220[247, 320]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211228__845.json0.0missing{\n "num_gpu": 99\n}missing
225Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231226_115621__49810.023.66153[387, 390]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_115621__498.json75.0missing{\n "num_gpu": 99\n}missing
226Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231226_115655__17100.033.43950[387, 561]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_115655__171.json50.0missing{\n "num_gpu": 99\n}missing
227Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231226_211434__48500.047.87410[387, 821]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211434__485.json50.0missing{\n "num_gpu": 99\n}missing
228Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue420231226_115521__40700.021.37240[385, 349]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_115521__407.json50.0missing{\n "num_gpu": 99\n}missing
229Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue420231226_115557__45200.034.80830[385, 589]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_115557__452.json50.0missing{\n "num_gpu": 99\n}missing
230Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue420231226_211346__54400.035.3430[385, 602]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_211346__544.json50.0missing{\n "num_gpu": 99\n}missing
231Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse420231227_100331__53100.043.66270[83, 237]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_100331__531.json25.0missing{\n "num_gpu": 99\n}missing
232Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue420231227_100413__25610.042.13943[83, 246]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_100413__256.json75.0missing{\n "num_gpu": 99\n}missing
233Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue420231227_100451__99200.037.21260[83, 216]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_100451__992.json50.0missing{\n "num_gpu": 99\n}missing
234Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse420231227_140857__63800.037.08190[83, 214]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_140857__638.json0.0missing{\n "num_gpu": 99\n}missing
235Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue420231227_140955__31300.057.90090[83, 340]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_140955__313.json50.0missing{\n "num_gpu": 99\n}missing
236Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231227_100136__35300.036.65250[122, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_100136__353.json0.0missing{\n "num_gpu": 99\n}missing
237Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_100204__48310.028.55571[122, 149]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_100204__483.json62.5missing{\n "num_gpu": 99\n}missing
238Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_100246__67510.041.63021[122, 224]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_100246__675.json62.5missing{\n "num_gpu": 99\n}missing
239Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_140807__98700.032.93590[122, 176]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_140807__987.json50.0missing{\n "num_gpu": 99\n}missing
240Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231227_140820__16600.011.72280[122, 53]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_140820__166.json0.0missing{\n "num_gpu": 99\n}missing
241Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_095754__62510.067.7431[248, 343]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095754__625.json62.5missing{\n "num_gpu": 99\n}missing
242Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_095949__33710.0114.6574[248, 645]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095949__337.json81.25missing{\n "num_gpu": 99\n}missing
243Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_100059__99410.068.98641[248, 369]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_100059__994.json62.5missing{\n "num_gpu": 99\n}missing
244Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_140627__89900.093.49550[248, 505]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_140627__899.json50.0missing{\n "num_gpu": 99\n}missing
245Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231227_140734__15600.066.34650[248, 346]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_140734__156.json25.0missing{\n "num_gpu": 99\n}missing
246Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_100858__53700.059.98750[396, 296]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_100858__537.json50.0missing{\n "num_gpu": 99\n}missing
247Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_101043__25200.0105.0070[396, 557]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101043__252.json50.0missing{\n "num_gpu": 99\n}missing
248Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_101207__40400.083.69383[396, 434]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101207__404.json68.75missing{\n "num_gpu": 99\n}missing
249Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_141410__97000.079.43010[396, 407]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_141410__970.json50.0missing{\n "num_gpu": 99\n}missing
250Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231227_141523__76200.073.43730[396, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_141523__762.json25.0missing{\n "num_gpu": 99\n}missing
251Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_100620__39700.089.48290[394, 468]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_100620__397.json50.0missing{\n "num_gpu": 99\n}missing
252Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_100644__46400.023.61611[394, 80]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_100644__464.json56.25missing{\n "num_gpu": 99\n}missing
253Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_100757__26110.073.24663[394, 374]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_100757__261.json75.0missing{\n "num_gpu": 99\n}missing
254Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_141057__87100.061.91350[394, 305]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_141057__871.json50.0missing{\n "num_gpu": 99\n}missing
255Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse420231227_141250__75500.0112.7980[394, 598]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_141250__755.json25.0missing{\n "num_gpu": 99\n}missing
256Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse420231219_211255__30200.011.88090[1, 370]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_211255__302.json0.0missingmissingmissing
257Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse420231219_211306__73000.011.32030[1, 353]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_211306__730.json25.0missingmissingmissing
258Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse420231224_223527__36300.012.72370[87, 318]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_223527__363.json25.0missing{\n "num_gpu": 99\n}missing
259Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue420231224_223535__96300.07.690950[87, 188]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_223535__963.json50.0missing{\n "num_gpu": 99\n}missing
260Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue420231226_211022__80200.015.80720[87, 395]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_211022__802.json50.0missing{\n "num_gpu": 99\n}missing
261Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_211221__78700.06.762870[1, 213]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_211221__787.json25.0missingmissingmissing
262Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_211228__86900.07.376540[1, 232]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_211228__869.json25.0missingmissingmissing
263Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue420231224_223507__95700.02.616610[129, 47]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223507__957.json50.0missing{\n "num_gpu": 99\n}missing
264Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_223515__97500.07.63590[129, 178]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223515__975.json0.0missing{\n "num_gpu": 99\n}missing
265Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue420231226_211006__34500.02.629210[129, 47]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_211006__345.json50.0missing{\n "num_gpu": 99\n}missing
266Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_211156__10900.011.54190[1, 341]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211156__109.json25.0missingmissingmissing
267Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231219_211205__74100.09.713350[1, 289]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211205__741.json0.0missingmissingmissing
268Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_223445__77910.022.12324[256, 368]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223445__779.json81.25missing{\n "num_gpu": 99\n}missing
269Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_223504__13600.019.29820[256, 455]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223504__136.json50.0missing{\n "num_gpu": 99\n}missing
270Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231226_211003__42500.022.04890[256, 375]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211003__425.json25.0missing{\n "num_gpu": 99\n}missing
271Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_211525__38000.027.8430[1, 739]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211525__380.json25.0missingmissingmissing
272Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_211541__28000.016.56450[1, 459]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211541__280.json25.0missingmissingmissing
273Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223642__14600.018.21730[396, 402]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223642__146.json50.0missing{\n "num_gpu": 99\n}missing
274Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231224_223657__82500.014.9480[396, 321]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223657__825.json25.0missing{\n "num_gpu": 99\n}missing
275Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231226_211105__23010.020.23281[396, 449]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211105__230.json62.5missing{\n "num_gpu": 99\n}missing
276Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_211416__44200.014.59840[1, 408]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211416__442.json25.0missingmissingmissing
277Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_211438__77400.022.19190[1, 602]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211438__774.json25.0missingmissingmissing
278Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_223611__14400.016.99020[394, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223611__144.json50.0missing{\n "num_gpu": 99\n}missing
279Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_223624__88000.012.78340[394, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223624__880.json50.0missing{\n "num_gpu": 99\n}missing
280Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_211044__11800.022.71220[394, 509]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_211044__118.json50.0missing{\n "num_gpu": 99\n}missing
281Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruefalse420231213_230354__16000.017.61940[82, 516]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_230354__160.json25.0missingmissingmissing
282Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruefalse420231224_214319__40900.06.577930[85, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_214319__409.json25.0missing{\n "num_gpu": 99\n}missing
283Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruetrue420231224_214323__87700.04.527940[85, 138]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_214323__877.json50.0missing{\n "num_gpu": 99\n}missing
284Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruetrue420231226_204611__83700.07.67410[85, 242]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_204611__837.json50.0missing{\n "num_gpu": 99\n}missing
285Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse420231213_230336__99900.07.709550[112, 217]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_230336__999.json25.0missingmissingmissing
286Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue420231224_214309__83900.02.980360[127, 80]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_214309__839.json50.0missing{\n "num_gpu": 99\n}missing
287Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue420231224_214312__14700.03.0110[127, 82]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_214312__147.json50.0missing{\n "num_gpu": 99\n}missing
288Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue420231226_204604__80200.06.271060[127, 190]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_204604__802.json50.0missing{\n "num_gpu": 99\n}missing
289Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231213_230329__97300.020.15130[239, 520]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230329__973.json50.0missingmissingmissing
290Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231224_214246__90000.025.2250[254, 599]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214246__900.json50.0missing{\n "num_gpu": 99\n}missing
291Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231224_214306__89610.019.67351[254, 591]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214306__896.json62.5missing{\n "num_gpu": 99\n}missing
292Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231226_204557__17110.021.13931[254, 467]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204557__171.json62.5missing{\n "num_gpu": 99\n}missing
293Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue420231213_230444__37800.015.10270[11, 410]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230444__378.json50.0missingmissingmissing
294Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue420231224_214422__87510.013.54871[394, 373]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214422__875.json62.5missing{\n "num_gpu": 99\n}missing
295Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue420231224_214441__87210.018.73651[394, 531]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214441__872.json62.5missing{\n "num_gpu": 99\n}missing
296Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse420231226_204649__75600.022.17080[394, 632]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_204649__756.json0.0missing{\n "num_gpu": 99\n}missing
297Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue420231213_230429__15000.019.0490[383, 429]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_230429__150.json50.0missingmissingmissing
298Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse420231224_214402__95400.011.06130[392, 295]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_214402__954.json0.0missing{\n "num_gpu": 99\n}missing
299Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue420231224_214408__96300.06.545060[392, 152]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_214408__963.json50.0missing{\n "num_gpu": 99\n}missing
300Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse420231226_204626__84500.014.80770[392, 410]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_204626__845.json25.0missing{\n "num_gpu": 99\n}missing
301Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTtruefalse420231213_231431__56700.012.95470[82, 383]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231213_231431__567.json25.0missingmissingmissing
302Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTtruetrue420231224_220602__83100.07.324480[85, 125]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231224_220602__831.json50.0missing{\n "num_gpu": 99\n}missing
303Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTfalsefalse420231224_220605__36600.02.84980[85, 39]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231224_220605__366.json0.0missing{\n "num_gpu": 99\n}missing
304Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTtruetrue420231226_205626__60000.09.09470[85, 159]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231226_205626__600.json50.0missing{\n "num_gpu": 99\n}missing
305Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTtruefalse420231213_231418__39600.06.750850[112, 188]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231213_231418__396.json25.0missingmissingmissing
306Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTfalsefalse420231224_220534__59600.017.84130[125, 316]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_220534__596.json0.0missing{\n "num_gpu": 99\n}missing
307Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTfalsefalse420231224_220554__42700.020.45190[125, 363]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_220554__427.json0.0missing{\n "num_gpu": 99\n}missing
308Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTfalsefalse420231226_205616__70100.03.435880[125, 46]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_205616__701.json0.0missing{\n "num_gpu": 99\n}missing
309Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTtruetrue420231213_231412__83600.014.24970[239, 361]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231412__836.json50.0missingmissingmissing
310Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTfalsefalse420231224_220511__30400.020.72750[252, 167]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220511__304.json0.0missing{\n "num_gpu": 99\n}missing
311Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTfalsefalse420231224_220516__61700.05.419930[252, 63]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220516__617.json0.0missing{\n "num_gpu": 99\n}missing
312Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTfalsefalse420231226_205613__71000.026.08480[252, 258]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205613__710.json0.0missing{\n "num_gpu": 99\n}missing
313Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTtruefalse420231213_231529__66800.019.53130[11, 528]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231529__668.json25.0missingmissingmissing
314Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231224_220741__11800.017.42910[389, 255]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220741__118.json0.0missing{\n "num_gpu": 99\n}missing
315Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231224_220846__64500.064.98730[389, 1045]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220846__645.json0.0missing{\n "num_gpu": 99\n}missing
316Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231226_205714__44500.015.05330[389, 214]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205714__445.json0.0missing{\n "num_gpu": 99\n}missing
317Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTtruefalse420231213_231509__77500.026.22220[383, 614]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231213_231509__775.json25.0missingmissingmissing
318Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTfalsefalse420231224_220658__51900.023.10720[386, 355]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_220658__519.json0.0missing{\n "num_gpu": 99\n}missing
319Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTfalsefalse420231224_220724__63200.025.25520[386, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_220724__632.json0.0missing{\n "num_gpu": 99\n}missing
320Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTtruetrue420231226_205659__32600.033.32490[386, 533]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_205659__326.json50.0missing{\n "num_gpu": 99\n}missing
321Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse420231219_211727__30700.09.126110[1, 288]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_211727__307.json25.0missingmissingmissing
322Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse420231219_211747__48900.020.00430[1, 599]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_211747__489.json25.0missingmissingmissing
323Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTtruetrue420231224_223744__58100.04.14680[79, 157]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_223744__581.json50.0missing{\n "num_gpu": 99\n}missing
324Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse420231224_223809__37500.024.60850[79, 909]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_223809__375.json0.0missing{\n "num_gpu": 99\n}missing
325Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse420231226_211146__40700.012.86380[79, 491]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_211146__407.json0.0missing{\n "num_gpu": 99\n}missing
326Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse420231219_211651__20700.010.95840[1, 338]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_211651__207.json25.0missingmissingmissing
327Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse420231219_211657__78500.05.712020[1, 181]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_211657__785.json25.0missingmissingmissing
328Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse420231224_223736__31900.030.89220[116, 1108]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_223736__319.json0.0missing{\n "num_gpu": 99\n}missing
329Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse420231224_223740__77900.04.632290[116, 172]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_223740__779.json0.0missing{\n "num_gpu": 99\n}missing
330Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse420231226_211133__32000.020.20410[116, 747]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_211133__320.json0.0missing{\n "num_gpu": 99\n}missing
331Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse420231219_211612__27900.011.57340[1, 342]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211612__279.json25.0missingmissingmissing
332Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse420231219_211633__58600.020.57120[1, 584]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211633__586.json25.0missingmissingmissing
333Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231224_223702__67100.05.116840[228, 28]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223702__671.json0.0missing{\n "num_gpu": 99\n}missing
334Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231224_223705__84700.02.445810[228, 68]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223705__847.json0.0missing{\n "num_gpu": 99\n}missing
335Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231226_211113__50100.07.950070[228, 147]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211113__501.json0.0missing{\n "num_gpu": 99\n}missing
336Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse420231219_211943__28600.015.82210[1, 440]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211943__286.json25.0missingmissingmissing
337Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse420231219_212000__72100.016.71870[1, 463]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_212000__721.json25.0missingmissingmissing
338Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231224_223854__42500.06.445990[368, 199]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223854__425.json0.0missing{\n "num_gpu": 99\n}missing
339Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231224_223919__84500.024.81880[368, 837]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223919__845.json0.0missing{\n "num_gpu": 99\n}missing
340Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231226_211159__40600.012.07250[368, 402]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211159__406.json0.0missing{\n "num_gpu": 99\n}missing
341Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse420231219_211855__98100.020.46160[1, 559]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_211855__981.json25.0missingmissingmissing
342Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse420231219_211911__49500.015.55110[1, 433]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_211911__495.json25.0missingmissingmissing
343Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse420231224_223824__98600.06.92730[365, 212]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_223824__986.json0.0missing{\n "num_gpu": 99\n}missing
344Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse420231224_223847__87600.023.20360[365, 783]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_223847__876.json0.0missing{\n "num_gpu": 99\n}missing
345Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse420231226_211147__23300.01.234760[365, 1]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_211147__233.json0.0missing{\n "num_gpu": 99\n}missing
346Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTtruefalse420231213_231609__69500.015.6380[82, 460]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231213_231609__695.json25.0missingmissingmissing
347Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTtruetrue420231224_221158__25400.038.65560[93, 297]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_221158__254.json50.0missing{\n "num_gpu": 99\n}missing
348Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTtruefalse420231224_221307__19800.068.69030[93, 531]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_221307__198.json25.0missing{\n "num_gpu": 99\n}missing
349Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTfalsefalse420231226_205944__53500.041.83970[93, 319]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_205944__535.json0.0missing{\n "num_gpu": 99\n}missing
350Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231213_231553__91300.07.786180[112, 219]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231213_231553__913.json50.0missingmissingmissing
351Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231224_221033__34410.012.00451[133, 72]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_221033__344.json62.5missing{\n "num_gpu": 99\n}missing
352Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231224_221119__39410.045.53813[133, 341]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_221119__394.json75.0missing{\n "num_gpu": 99\n}missing
353Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231226_205901__52510.039.96381[133, 297]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_205901__525.json62.5missing{\n "num_gpu": 99\n}missing
354Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse420231213_231545__74400.016.25760[239, 416]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231545__744.json25.0missingmissingmissing
355Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue420231224_220950__61210.063.93634[260, 282]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220950__612.json81.25missing{\n "num_gpu": 99\n}missing
356Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue420231224_221021__79210.030.52284[260, 198]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_221021__792.json81.25missing{\n "num_gpu": 99\n}missing
357Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue420231226_205821__85500.066.97190[260, 322]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205821__855.json50.0missing{\n "num_gpu": 99\n}missing
358Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse420231213_231708__42200.021.92830[11, 587]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231708__422.json0.0missingmissingmissing
359Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse420231224_221730__17400.047.39130[397, 305]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_221730__174.json25.0missing{\n "num_gpu": 99\n}missing
360Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue420231224_221757__86810.026.34793[397, 141]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_221757__868.json75.0missing{\n "num_gpu": 99\n}missing
361Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue420231226_210127__77910.046.2013[397, 296]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210127__779.json75.0missing{\n "num_gpu": 99\n}missing
362Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse420231213_231646__45400.022.40590[383, 518]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231213_231646__454.json25.0missingmissingmissing
363Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue420231224_221538__11200.071.82180[394, 492]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_221538__112.json50.0missing{\n "num_gpu": 99\n}missing
364Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue420231224_221642__39300.063.94710[394, 432]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_221642__393.json50.0missing{\n "num_gpu": 99\n}missing
365Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse420231226_210041__39500.056.95330[394, 379]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_210041__395.json25.0missing{\n "num_gpu": 99\n}missing
366Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse420231219_210350__14900.011.36690[1, 355]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_210350__149.json25.0missingmissingmissing
367Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse420231219_210401__52900.010.51930[1, 330]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_210401__529.json25.0missingmissingmissing
368Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse420231224_223004__85100.016.61180[87, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_223004__851.json25.0missing{\n "num_gpu": 99\n}missing
369Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue420231224_223015__98010.010.24731[87, 168]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_223015__980.json62.5missing{\n "num_gpu": 99\n}missing
370Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue420231226_210750__45910.015.92491[87, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_210750__459.json62.5missing{\n "num_gpu": 99\n}missing
371Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_210317__74300.05.791130[1, 184]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210317__743.json25.0missingmissingmissing
372Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse420231219_210326__70600.08.974850[1, 280]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210326__706.json25.0missingmissingmissing
373Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue420231224_222931__46200.012.4660[129, 198]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222931__462.json50.0missing{\n "num_gpu": 99\n}missing
374Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_222948__79300.017.02550[129, 277]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222948__793.json0.0missing{\n "num_gpu": 99\n}missing
375Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231226_210734__78900.012.18070[129, 193]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_210734__789.json0.0missing{\n "num_gpu": 99\n}missing
376Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_210253__10100.016.95360[1, 489]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210253__101.json25.0missingmissingmissing
377Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231219_210305__72500.011.39490[1, 337]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210305__725.json0.0missingmissingmissing
378Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231224_222859__31000.034.21450[256, 388]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_222859__310.json25.0missing{\n "num_gpu": 99\n}missing
379Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_222918__56500.018.65820[256, 288]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_222918__565.json50.0missing{\n "num_gpu": 99\n}missing
380Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231226_210721__58300.036.58230[256, 444]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_210721__583.json50.0missing{\n "num_gpu": 99\n}missing
381Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_210626__36300.022.32060[1, 605]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210626__363.json25.0missingmissingmissing
382Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_210645__52000.019.60910[1, 537]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210645__520.json25.0missingmissingmissing
383Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223201__48800.019.02670[396, 269]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223201__488.json50.0missing{\n "num_gpu": 99\n}missing
384Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223220__77200.018.40850[396, 259]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223220__772.json50.0missing{\n "num_gpu": 99\n}missing
385Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231226_210835__62100.018.83880[396, 266]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210835__621.json50.0missing{\n "num_gpu": 99\n}missing
386Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231219_210527__28900.023.57550[1, 636]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210527__289.json0.0missingmissingmissing
387Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231219_210539__22600.011.85520[1, 335]0.5.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210539__226.json0.0missingmissingmissing
388Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231224_223115__16900.026.98970[394, 401]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223115__169.json0.0missing{\n "num_gpu": 99\n}missing
389Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse420231224_223142__96100.027.2660[394, 406]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223142__961.json25.0missing{\n "num_gpu": 99\n}missing
390Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_210816__34000.026.57010[394, 394]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_210816__340.json50.0missing{\n "num_gpu": 99\n}missing
391Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTtruefalse420231213_231254__18800.010.11450[82, 299]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231213_231254__188.json25.0missingmissingmissing
392Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTtruetrue420231224_220404__64000.05.898680[88, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_220404__640.json50.0missing{\n "num_gpu": 99\n}missing
393Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTfalsefalse420231224_220412__70600.07.520910[88, 422]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_220412__706.json0.0missing{\n "num_gpu": 99\n}missing
394Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTtruetrue420231226_205530__75700.05.227820[88, 295]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_205530__757.json50.0missing{\n "num_gpu": 99\n}missing
395Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTtruetrue420231213_231244__31800.07.075030[112, 197]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231213_231244__318.json50.0missingmissingmissing
396Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTtruetrue420231224_220353__40300.04.950090[125, 273]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_220353__403.json50.0missing{\n "num_gpu": 99\n}missing
397Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse420231224_220359__78900.05.22960[125, 288]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_220359__789.json0.0missing{\n "num_gpu": 99\n}missing
398Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTtruetrue420231226_205524__72100.01.826970[125, 92]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_205524__721.json50.0missing{\n "num_gpu": 99\n}missing
399Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue420231213_231237__29800.020.170[239, 522]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231237__298.json50.0missingmissingmissing
400Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue420231224_220339__30400.015.56420[232, 646]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220339__304.json50.0missing{\n "num_gpu": 99\n}missing
401Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse420231224_220348__59300.08.725320[232, 445]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220348__593.json25.0missing{\n "num_gpu": 99\n}missing
402Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse420231226_205523__76000.09.481930[232, 348]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205523__760.json0.0missing{\n "num_gpu": 99\n}missing
403Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231213_231357__11000.019.66350[11, 531]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231357__110.json0.0missingmissingmissing
404Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231224_220440__33900.05.623580[375, 247]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220440__339.json0.0missing{\n "num_gpu": 99\n}missing
405Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse420231224_220450__61500.09.69120[375, 454]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220450__615.json25.0missing{\n "num_gpu": 99\n}missing
406Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231226_205547__15100.010.6740[375, 502]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205547__151.json0.0missing{\n "num_gpu": 99\n}missing
407Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTtruetrue420231213_231337__26800.024.2090[383, 563]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231213_231337__268.json50.0missingmissingmissing
408Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTfalsefalse420231224_220429__73700.06.853570[373, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_220429__737.json0.0missing{\n "num_gpu": 99\n}missing
409Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTfalsefalse420231224_220435__54900.05.62920[373, 248]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_220435__549.json0.0missing{\n "num_gpu": 99\n}missing
410Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTfalsefalse420231226_205536__90200.06.429830[373, 289]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_205536__902.json0.0missing{\n "num_gpu": 99\n}missing
411Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruefalse420231213_230516__55000.010.74840[82, 319]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_230516__550.json25.0missingmissingmissing
412Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231224_214559__80000.07.974350[87, 251]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_214559__800.json50.0missing{\n "num_gpu": 99\n}missing
413Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231224_214604__29300.05.462090[87, 169]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_214604__293.json50.0missing{\n "num_gpu": 99\n}missing
414Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231226_204732__98300.013.19530[87, 421]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_204732__983.json50.0missing{\n "num_gpu": 99\n}missing
415Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruefalse420231213_230506__91000.06.417890[112, 178]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_230506__910.json25.0missingmissingmissing
416Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruetrue420231224_214544__13600.015.42120[129, 483]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_214544__136.json50.0missing{\n "num_gpu": 99\n}missing
417Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruetrue420231224_214551__13600.06.497530[129, 193]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_214551__136.json50.0missing{\n "num_gpu": 99\n}missing
418Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruetrue420231226_204718__91700.08.157320[129, 248]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_204718__917.json50.0missing{\n "num_gpu": 99\n}missing
419Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse420231213_230459__31900.015.16550[239, 385]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230459__319.json0.0missingmissingmissing
420Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue420231224_214512__97100.031.19721[256, 768]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214512__971.json56.25missing{\n "num_gpu": 99\n}missing
421Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue420231224_214528__43300.015.59940[256, 466]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214528__433.json50.0missing{\n "num_gpu": 99\n}missing
422Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue420231226_204710__17900.021.59970[256, 486]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204710__179.json50.0missing{\n "num_gpu": 99\n}missing
423Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse420231213_230604__46900.011.78430[11, 327]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230604__469.json0.0missingmissingmissing
424Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue420231224_214704__59500.015.72350[396, 439]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214704__595.json50.0missing{\n "num_gpu": 99\n}missing
425Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue420231224_214712__55900.07.485271[396, 182]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214712__559.json56.25missing{\n "num_gpu": 99\n}missing
426Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue420231226_204803__26210.019.96721[396, 566]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_204803__262.json62.5missing{\n "num_gpu": 99\n}missing
427Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231213_230552__35100.022.64180[383, 526]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_230552__351.json50.0missingmissingmissing
428Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231224_214634__68700.013.53550[394, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_214634__687.json50.0missing{\n "num_gpu": 99\n}missing
429Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231224_214648__65000.014.29570[394, 395]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_214648__650.json50.0missing{\n "num_gpu": 99\n}missing
430Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231226_204743__23600.010.37340[394, 272]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_204743__236.json50.0missing{\n "num_gpu": 99\n}missing
431Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruefalse420231213_230635__77300.017.80710[82, 522]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_230635__773.json25.0missingmissingmissing
432Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruefalse420231224_214941__94100.036.29420[83, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_214941__941.json25.0missing{\n "num_gpu": 99\n}missing
433Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruetrue420231224_215118__49900.096.60470[83, 719]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_215118__499.json50.0missing{\n "num_gpu": 99\n}missing
434Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruefalse420231226_204956__29800.041.05590[83, 302]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_204956__298.json25.0missing{\n "num_gpu": 99\n}missing
435Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231213_230617__42300.05.680540[112, 154]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_230617__423.json50.0missingmissingmissing
436Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231224_214840__70500.09.995070[122, 58]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_214840__705.json50.0missing{\n "num_gpu": 99\n}missing
437Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231224_214904__52110.024.03011[122, 167]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_214904__521.json62.5missing{\n "num_gpu": 99\n}missing
438Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231226_204914__19510.09.227831[122, 52]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_204914__195.json62.5missing{\n "num_gpu": 99\n}missing
439Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse420231213_230612__17400.07.557650[239, 171]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230612__174.json25.0missingmissingmissing
440Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse420231224_214806__89100.053.85690[248, 159]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214806__891.json25.0missing{\n "num_gpu": 99\n}missing
441Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse420231224_214830__40700.024.40470[248, 148]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214830__407.json0.0missing{\n "num_gpu": 99\n}missing
442Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse420231226_204905__34900.062.15040[248, 242]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204905__349.json0.0missing{\n "num_gpu": 99\n}missing
443Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue420231213_230726__17000.019.35070[11, 519]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230726__170.json50.0missingmissingmissing
444Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue420231224_215516__99000.037.85410[396, 221]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215516__990.json50.0missing{\n "num_gpu": 99\n}missing
445Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse420231224_215614__18900.057.43870[396, 365]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215614__189.json25.0missing{\n "num_gpu": 99\n}missing
446Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse420231226_205220__65600.052.98140[396, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205220__656.json25.0missing{\n "num_gpu": 99\n}missing
447Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTfalsefalse420231213_230707__42800.018.69630[383, 424]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_230707__428.json0.0missingmissingmissing
448Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTtruefalse420231224_215356__67700.053.34730[394, 336]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_215356__677.json25.0missing{\n "num_gpu": 99\n}missing
449Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTtruetrue420231224_215438__23710.041.67871[394, 250]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_215438__237.json62.5missing{\n "num_gpu": 99\n}missing
450Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTtruefalse420231226_205127__55100.090.47670[394, 600]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_205127__551.json25.0missing{\n "num_gpu": 99\n}missing
451Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruefalse520231213_232514__95800.013.3190[112, 384]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231213_232514__958.json25.0missingmissingmissing
452Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruetrue520231224_225931__25300.013.55630[120, 238]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_225931__253.json50.0missing{\n "num_gpu": 99\n}missing
453Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruetrue520231224_225944__36200.012.45070[120, 217]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_225944__362.json50.0missing{\n "num_gpu": 99\n}missing
454Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruetrue520231226_212420__78600.015.40320[120, 261]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_212420__786.json50.0missing{\n "num_gpu": 99\n}missing
455Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231213_232501__56900.011.78510[141, 328]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231213_232501__569.json25.0missingmissingmissing
456Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231224_225911__41250.013.31112[158, 227]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_225911__412.json100.0missing{\n "num_gpu": 99\n}missing
457Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231224_225917__40800.05.563460[158, 81]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_225917__408.json0.0missing{\n "num_gpu": 99\n}missing
458Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_212404__49600.013.5110[158, 217]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_212404__496.json50.0missing{\n "num_gpu": 99\n}missing
459Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231213_232449__11900.015.37340[311, 364]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232449__119.json0.0missingmissingmissing
460Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231224_225851__50050.024.29622[329, 212]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_225851__500.json100.0missing{\n "num_gpu": 99\n}missing
461Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231224_225858__27700.06.744980[329, 73]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_225858__277.json0.0missing{\n "num_gpu": 99\n}missing
462Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_212350__45000.021.26140[329, 161]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212350__450.json0.0missing{\n "num_gpu": 99\n}missing
463Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231213_232613__12000.020.3920[11, 544]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232613__120.json50.0missingmissingmissing
464Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231224_230133__76200.036.47960[423, 579]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230133__762.json50.0missing{\n "num_gpu": 99\n}missing
465Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231224_230157__87100.022.77690[423, 345]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230157__871.json25.0missing{\n "num_gpu": 99\n}missing
466Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_212512__30300.016.20210[423, 220]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212512__303.json50.0missing{\n "num_gpu": 99\n}missing
467Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231213_232553__61300.020.28370[412, 450]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231213_232553__613.json50.0missingmissingmissing
468Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231224_230032__82500.028.58270[420, 446]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_230032__825.json0.0missing{\n "num_gpu": 99\n}missing
469Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231224_230057__21300.024.85350[420, 382]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_230057__213.json50.0missing{\n "num_gpu": 99\n}missing
470Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_212456__77400.035.59770[420, 545]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_212456__774.json50.0missing{\n "num_gpu": 99\n}missing
471Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonInJulia1SHOTfalsefalse520231213_232656__69100.012.95910[112, 373]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__InJulia__1SHOT__20231213_232656__691.json0.0missingmissingmissing
472Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonInJulia1SHOTfalsefalse520231224_230310__98700.019.97440[94, 362]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_230310__987.json0.0missing{\n "num_gpu": 99\n}missing
473Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonInJulia1SHOTfalsefalse520231224_230323__34600.013.74820[94, 246]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_230323__346.json0.0missing{\n "num_gpu": 99\n}missing
474Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231213_232643__16300.05.086130[141, 128]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231213_232643__163.json0.0missingmissingmissing
475Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231224_230243__75200.029.38510[95, 533]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_230243__752.json0.0missing{\n "num_gpu": 99\n}missing
476Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231224_230250__29700.06.6510[95, 112]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_230250__297.json0.0missing{\n "num_gpu": 99\n}missing
477Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruefalse520231213_232638__83500.024.35320[311, 598]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232638__835.json25.0missingmissingmissing
478Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231224_230212__24200.015.00380[204, 58]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230212__242.json0.0missing{\n "num_gpu": 99\n}missing
479Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231213_232753__16500.020.47150[11, 546]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232753__165.json25.0missingmissingmissing
480Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231224_230551__63800.08.09790[112, 135]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230551__638.json0.0missing{\n "num_gpu": 99\n}missing
481Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231224_230553__16800.02.292630[112, 24]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230553__168.json0.0missing{\n "num_gpu": 99\n}missing
482Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231213_232732__71800.026.28380[412, 600]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231213_232732__718.json50.0missingmissingmissing
483Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231224_230535__47300.024.90750[109, 447]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_230535__473.json0.0missing{\n "num_gpu": 99\n}missing
484Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231224_230543__85000.08.027350[109, 134]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_230543__850.json0.0missing{\n "num_gpu": 99\n}missing
485Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_212201__36800.020.40520[1, 604]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_212201__368.json0.0missingmissingmissing
486Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_212216__68700.014.38850[1, 438]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_212216__687.json0.0missingmissingmissing
487Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231224_232702__97750.040.82842[118, 232]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_232702__977.json100.0missing{\n "num_gpu": 99\n}missing
488Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231224_232806__26100.063.78850[118, 379]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_232806__261.json25.0missing{\n "num_gpu": 99\n}missing
489Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231226_213533__40000.045.21630[118, 266]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_213533__400.json25.0missing{\n "num_gpu": 99\n}missing
490Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_212117__97000.08.902310[1, 275]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212117__970.json25.0missingmissingmissing
491Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_212119__14300.02.480830[1, 79]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212119__143.json25.0missingmissingmissing
492Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231224_232544__25200.052.44880[159, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_232544__252.json0.0missing{\n "num_gpu": 99\n}missing
493Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_232620__19020.035.35752[159, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_232620__190.json85.0missing{\n "num_gpu": 99\n}missing
494Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_213448__25100.054.43960[159, 317]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_213448__251.json0.0missing{\n "num_gpu": 99\n}missing
495Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_212039__93200.020.66870[1, 574]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212039__932.json25.0missingmissingmissing
496Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_212054__36100.015.53670[1, 441]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212054__361.json25.0missingmissingmissing
497Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231224_232411__59050.078.50922[334, 259]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_232411__590.json100.0missing{\n "num_gpu": 99\n}missing
498Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231224_232452__73200.039.46020[334, 187]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_232452__732.json25.0missing{\n "num_gpu": 99\n}missing
499Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_213353__82620.080.96412[334, 297]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_213353__826.json85.0missing{\n "num_gpu": 99\n}missing
500Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_212458__60500.016.27980[1, 448]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_212458__605.json25.0missingmissingmissing
501Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_212518__44800.020.59760[1, 557]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_212518__448.json25.0missingmissingmissing
502Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_233230__52300.045.68350[447, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233230__523.json50.0missing{\n "num_gpu": 99\n}missing
503Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_233257__27600.026.06780[447, 92]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233257__276.json50.0missing{\n "num_gpu": 99\n}missing
504Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_213758__26400.055.15890[447, 269]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_213758__264.json50.0missing{\n "num_gpu": 99\n}missing
505Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_212353__42400.036.28720[1, 929]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212353__424.json25.0missingmissingmissing
506Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_212419__97700.026.38180[1, 699]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212419__977.json25.0missingmissingmissing
507Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_233040__88500.066.70250[445, 335]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233040__885.json50.0missing{\n "num_gpu": 99\n}missing
508Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231224_233145__95800.063.18670[445, 312]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233145__958.json25.0missing{\n "num_gpu": 99\n}missing
509Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_213702__16300.089.1870[445, 471]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_213702__163.json50.0missing{\n "num_gpu": 99\n}missing
510Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231226_215357__32200.07.711960[118, 291]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_215357__322.json0.0missing{\n "num_gpu": 99\n}missing
511Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_101255__83300.07.572540[118, 286]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_101255__833.json25.0missing{\n "num_gpu": 99\n}missing
512Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_101303__49400.08.003990[118, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_101303__494.json0.0missing{\n "num_gpu": 99\n}missing
513Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_101318__50900.014.75640[118, 553]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_101318__509.json25.0missing{\n "num_gpu": 99\n}missing
514Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_215349__38500.07.693350[155, 284]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_215349__385.json0.0missing{\n "num_gpu": 99\n}missing
515Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_101235__87600.08.442830[155, 313]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_101235__876.json50.0missing{\n "num_gpu": 99\n}missing
516Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_101240__23800.05.32090[155, 193]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_101240__238.json50.0missing{\n "num_gpu": 99\n}missing
517Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_101248__79700.07.09560[155, 261]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_101248__797.json0.0missing{\n "num_gpu": 99\n}missing
518Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_215341__51100.09.860170[324, 203]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215341__511.json0.0missing{\n "num_gpu": 99\n}missing
519Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_101216__70700.08.359440[324, 154]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101216__707.json25.0missing{\n "num_gpu": 99\n}missing
520Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_101223__17100.07.458480[324, 243]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101223__171.json0.0missing{\n "num_gpu": 99\n}missing
521Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_101226__57300.03.398980[324, 90]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101226__573.json50.0missing{\n "num_gpu": 99\n}missing
522Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_215416__96500.03.45850[407, 80]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215416__965.json0.0missing{\n "num_gpu": 99\n}missing
523Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_101342__65600.010.3420[407, 332]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101342__656.json0.0missing{\n "num_gpu": 99\n}missing
524Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_101350__34900.08.58850[407, 269]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101350__349.json0.0missing{\n "num_gpu": 99\n}missing
525Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_101401__99100.010.1890[407, 327]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101401__991.json0.0missing{\n "num_gpu": 99\n}missing
526Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231226_215412__50300.015.35860[404, 508]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_215412__503.json25.0missing{\n "num_gpu": 99\n}missing
527Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_101322__82300.03.803510[404, 93]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_101322__823.json0.0missing{\n "num_gpu": 99\n}missing
528Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_101327__30400.05.191290[404, 145]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_101327__304.json0.0missing{\n "num_gpu": 99\n}missing
529Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231227_101331__95100.04.440210[404, 117]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_101331__951.json25.0missing{\n "num_gpu": 99\n}missing
530Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTtruefalse520231213_231800__19900.014.34830[112, 413]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231213_231800__199.json25.0missingmissingmissing
531Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTfalsefalse520231224_224047__80200.024.83590[112, 698]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231224_224047__802.json0.0missing{\n "num_gpu": 99\n}missing
532Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTtruefalse520231224_224112__80900.024.72410[1, 716]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231224_224112__809.json25.0missing{\n "num_gpu": 99\n}missing
533Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTtruefalse520231226_211603__90100.012.32880[112, 361]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231226_211603__901.json25.0missing{\n "num_gpu": 99\n}missing
534Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTfalsefalse520231213_231745__96600.014.06350[141, 393]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231213_231745__966.json0.0missingmissingmissing
535Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTtruetrue520231224_224015__81800.011.08280[141, 308]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_224015__818.json50.0missing{\n "num_gpu": 99\n}missing
536Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTtruetrue520231224_224022__53100.06.819890[1, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_224022__531.json50.0missing{\n "num_gpu": 99\n}missing
537Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTfalsefalse520231226_211551__63500.017.12470[141, 486]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_211551__635.json0.0missing{\n "num_gpu": 99\n}missing
538Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTtruefalse520231213_231731__18500.023.11920[311, 567]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231731__185.json25.0missingmissingmissing
539Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTfalsefalse520231224_223947__85900.028.06870[329, 545]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223947__859.json0.0missing{\n "num_gpu": 99\n}missing
540Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTfalsefalse520231224_224004__55900.017.19740[1, 483]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224004__559.json0.0missing{\n "num_gpu": 99\n}missing
541Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_211534__53300.015.87030[329, 240]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211534__533.json0.0missing{\n "num_gpu": 99\n}missing
542Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTtruefalse520231213_231858__33100.018.59630[11, 500]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231858__331.json25.0missingmissingmissing
543Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTtruetrue520231224_224237__69700.017.32830[11, 468]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224237__697.json50.0missing{\n "num_gpu": 99\n}missing
544Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTtruetrue520231224_224303__18830.025.71892[1, 680]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224303__188.json90.0missing{\n "num_gpu": 99\n}missing
545Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTfalsefalse520231226_211658__60500.021.97960[11, 593]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211658__605.json0.0missing{\n "num_gpu": 99\n}missing
546Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTfalsefalse520231213_231839__65200.021.4870[412, 480]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231213_231839__652.json0.0missingmissingmissing
547Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTfalsefalse520231224_224205__63000.022.66240[412, 511]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_224205__630.json0.0missing{\n "num_gpu": 99\n}missing
548Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTtruefalse520231224_224220__66200.014.90630[1, 412]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_224220__662.json25.0missing{\n "num_gpu": 99\n}missing
549Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTfalsefalse520231226_211636__53300.032.20920[412, 754]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_211636__533.json0.0missing{\n "num_gpu": 99\n}missing
550Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTfalsefalse520231213_232850__88100.024.67540[112, 694]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231213_232850__881.json0.0missingmissingmissing
551Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTtruetrue520231224_230642__88600.09.192221[112, 293]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231224_230642__886.json62.5missing{\n "num_gpu": 99\n}missing
552Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTtruetrue520231224_230651__56000.08.543930[112, 270]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231224_230651__560.json50.0missing{\n "num_gpu": 99\n}missing
553Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTtruetrue520231226_212545__13300.06.495870[112, 203]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231226_212545__133.json50.0missing{\n "num_gpu": 99\n}missing
554Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTtruetrue520231213_232826__27800.016.87480[141, 471]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231213_232826__278.json50.0missingmissingmissing
555Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTtruefalse520231224_230627__53100.08.297960[151, 258]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_230627__531.json25.0missing{\n "num_gpu": 99\n}missing
556Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTfalsefalse520231224_230633__37400.05.774360[151, 173]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_230633__374.json0.0missing{\n "num_gpu": 99\n}missing
557Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTtruetrue520231226_212538__23600.09.450830[151, 296]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_212538__236.json50.0missing{\n "num_gpu": 99\n}missing
558Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231213_232809__84500.015.8180[311, 376]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232809__845.json0.0missingmissingmissing
559Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTtruefalse520231224_230609__99300.015.83050[321, 275]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230609__993.json25.0missing{\n "num_gpu": 99\n}missing
560Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231224_230619__29300.09.583970[321, 266]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230619__293.json0.0missing{\n "num_gpu": 99\n}missing
561Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231226_212528__90100.015.71370[321, 278]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212528__901.json0.0missing{\n "num_gpu": 99\n}missing
562Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruefalse520231213_233007__61600.026.93420[11, 704]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233007__616.json25.0missingmissingmissing
563Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruetrue520231224_230741__37100.09.640820[415, 254]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230741__371.json50.0missing{\n "num_gpu": 99\n}missing
564Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruetrue520231224_230752__48400.010.96370[415, 295]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230752__484.json50.0missing{\n "num_gpu": 99\n}missing
565Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_212604__89000.010.67550[415, 285]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212604__890.json50.0missing{\n "num_gpu": 99\n}missing
566Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruetrue520231213_232941__63200.029.56010[412, 680]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231213_232941__632.json50.0missingmissingmissing
567Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruefalse520231224_230719__69900.011.84080[412, 321]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_230719__699.json25.0missing{\n "num_gpu": 99\n}missing
568Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruetrue520231224_230730__13600.011.63850[412, 318]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_230730__136.json50.0missing{\n "num_gpu": 99\n}missing
569Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruetrue520231226_212553__38700.08.284170[412, 212]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_212553__387.json50.0missing{\n "num_gpu": 99\n}missing
570Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_174702__41600.011.25760[112, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174702__416.json50.0missing{\n "num_gpu": 99\n}missing
571Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_174714__63500.011.09880[112, 208]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174714__635.json50.0missing{\n "num_gpu": 99\n}missing
572Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_174727__26400.012.8090[112, 238]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174727__264.json50.0missing{\n "num_gpu": 99\n}missing
573Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_174621__73340.011.59452[151, 213]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174621__733.json95.0missing{\n "num_gpu": 99\n}missing
574Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_174638__97200.016.58950[151, 313]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174638__972.json50.0missing{\n "num_gpu": 99\n}missing
575Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_174651__31700.012.63411[151, 233]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174651__317.json62.5missing{\n "num_gpu": 99\n}missing
576Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_174529__68900.018.53150[321, 325]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174529__689.json25.0missing{\n "num_gpu": 99\n}missing
577Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_174551__38700.022.30681[321, 396]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174551__387.json62.5missing{\n "num_gpu": 99\n}missing
578Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_174609__58100.016.81550[321, 292]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174609__581.json0.0missing{\n "num_gpu": 99\n}missing
579Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_174835__33740.018.20522[415, 308]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174835__337.json95.0missing{\n "num_gpu": 99\n}missing
580Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_174857__23300.021.42520[415, 353]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174857__233.json25.0missing{\n "num_gpu": 99\n}missing
581Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_174912__61300.014.65230[415, 241]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174912__613.json25.0missing{\n "num_gpu": 99\n}missing
582Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_174748__76200.020.51690[412, 352]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174748__762.json50.0missing{\n "num_gpu": 99\n}missing
583Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_174758__67200.08.771520[412, 127]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174758__672.json25.0missing{\n "num_gpu": 99\n}missing
584Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_174817__47900.019.43920[412, 333]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174817__479.json25.0missing{\n "num_gpu": 99\n}missing
585Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_213311__61800.016.56160[1, 499]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_213311__618.json0.0missingmissingmissing
586Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_213328__16000.016.2820[1, 491]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_213328__160.json25.0missingmissingmissing
587Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231224_233708__46300.03.674770[111, 79]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_233708__463.json0.0missing{\n "num_gpu": 99\n}missing
588Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231224_233720__80600.011.45930[111, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_233720__806.json25.0missing{\n "num_gpu": 99\n}missing
589Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_214023__65200.08.59890[111, 207]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_214023__652.json50.0missing{\n "num_gpu": 99\n}missing
590Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_213227__46100.017.21950[1, 511]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213227__461.json25.0missingmissingmissing
591Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_213235__83100.08.554770[1, 265]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213235__831.json25.0missingmissingmissing
592Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231224_233700__27600.03.540850[152, 71]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233700__276.json0.0missing{\n "num_gpu": 99\n}missing
593Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233704__66800.04.045860[152, 84]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233704__668.json50.0missing{\n "num_gpu": 99\n}missing
594Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_214015__46700.06.75310[152, 154]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_214015__467.json50.0missing{\n "num_gpu": 99\n}missing
595Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213131__96800.028.73510[1, 774]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213131__968.json0.0missingmissingmissing
596Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213154__28200.022.43630[1, 619]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213154__282.json0.0missingmissingmissing
597Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231224_233641__32800.016.9330[332, 244]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233641__328.json25.0missing{\n "num_gpu": 99\n}missing
598Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231224_233657__26700.016.16020[332, 362]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233657__267.json0.0missing{\n "num_gpu": 99\n}missing
599Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_214008__36500.030.54040[332, 582]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_214008__365.json50.0missing{\n "num_gpu": 99\n}missing
600Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_213610__86800.019.14210[1, 521]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213610__868.json25.0missingmissingmissing
601Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_213630__33800.020.19930[1, 547]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213630__338.json25.0missingmissingmissing
602Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_233826__78300.015.41930[419, 329]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233826__783.json50.0missing{\n "num_gpu": 99\n}missing
603Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231224_233842__54700.015.94890[419, 342]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233842__547.json0.0missing{\n "num_gpu": 99\n}missing
604Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231226_214126__87300.028.73420[419, 649]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_214126__873.json25.0missing{\n "num_gpu": 99\n}missing
605Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_213508__31500.028.65650[1, 753]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_213508__315.json25.0missingmissingmissing
606Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_213532__98200.023.24810[1, 623]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_213532__982.json25.0missingmissingmissing
607Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231224_233752__62800.08.059310[417, 146]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233752__628.json0.0missing{\n "num_gpu": 99\n}missing
608Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231224_233811__44100.018.47260[417, 404]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233811__441.json0.0missing{\n "num_gpu": 99\n}missing
609Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_214057__89900.033.48940[417, 760]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_214057__899.json50.0missing{\n "num_gpu": 99\n}missing
610Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_223421__49000.013.79610[110, 431]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223421__490.json25.0missing{\n "num_gpu": 99\n}missing
611Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223432__20700.010.82640[110, 336]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223432__207.json50.0missing{\n "num_gpu": 99\n}missing
612Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223443__53200.010.2090[110, 316]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223443__532.json50.0missing{\n "num_gpu": 99\n}missing
613Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223453__64200.010.52130[110, 326]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223453__642.json50.0missing{\n "num_gpu": 99\n}missing
614Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223502__36500.07.570160[110, 230]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223502__365.json50.0missing{\n "num_gpu": 99\n}missing
615Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_223352__24100.04.008050[151, 108]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223352__241.json0.0missing{\n "num_gpu": 99\n}missing
616Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_223355__14400.03.259640[151, 84]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223355__144.json50.0missing{\n "num_gpu": 99\n}missing
617Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_223359__31500.03.532850[151, 93]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223359__315.json0.0missing{\n "num_gpu": 99\n}missing
618Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_223403__36600.03.935640[151, 106]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223403__366.json0.0missing{\n "num_gpu": 99\n}missing
619Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_223407__37100.04.054860[151, 110]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223407__371.json50.0missing{\n "num_gpu": 99\n}missing
620Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_223252__28100.012.96090[331, 286]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223252__281.json50.0missing{\n "num_gpu": 99\n}missing
621Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_223307__93900.014.56060[331, 410]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223307__939.json0.0missing{\n "num_gpu": 99\n}missing
622Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_223320__44600.013.08760[331, 365]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223320__446.json0.0missing{\n "num_gpu": 99\n}missing
623Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_223337__36350.017.41092[331, 497]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223337__363.json100.0missing{\n "num_gpu": 99\n}missing
624Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_223347__83900.09.320010[331, 247]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223347__839.json50.0missing{\n "num_gpu": 99\n}missing
625Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_223644__25300.011.48230[418, 298]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223644__253.json0.0missing{\n "num_gpu": 99\n}missing
626Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223657__51100.013.43460[418, 358]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223657__511.json50.0missing{\n "num_gpu": 99\n}missing
627Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223711__31200.013.59210[418, 363]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223711__312.json50.0missing{\n "num_gpu": 99\n}missing
628Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223727__73400.015.86530[418, 432]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223727__734.json50.0missing{\n "num_gpu": 99\n}missing
629Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223740__74300.012.32640[418, 324]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223740__743.json50.0missing{\n "num_gpu": 99\n}missing
630Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223528__81800.026.5240[416, 749]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223528__818.json50.0missing{\n "num_gpu": 99\n}missing
631Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223541__85500.012.91430[416, 347]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223541__855.json50.0missing{\n "num_gpu": 99\n}missing
632Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223606__57500.024.14320[416, 679]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223606__575.json50.0missing{\n "num_gpu": 99\n}missing
633Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223620__72900.014.0610[416, 381]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223620__729.json50.0missing{\n "num_gpu": 99\n}missing
634Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223632__42150.011.36792[416, 299]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223632__421.json100.0missing{\n "num_gpu": 99\n}missing
635Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_224037__95500.015.14250[110, 373]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224037__955.json50.0missing{\n "num_gpu": 99\n}missing
636Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_224053__40300.014.51930[110, 357]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224053__403.json0.0missing{\n "num_gpu": 99\n}missing
637Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_224104__37200.011.43350[110, 279]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224104__372.json25.0missing{\n "num_gpu": 99\n}missing
638Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_224118__72200.014.43210[110, 355]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224118__722.json0.0missing{\n "num_gpu": 99\n}missing
639Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_224134__74200.015.76170[110, 389]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224134__742.json25.0missing{\n "num_gpu": 99\n}missing
640Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_223948__41700.09.812540[151, 232]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_223948__417.json50.0missing{\n "num_gpu": 99\n}missing
641Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_223954__78600.05.54040[151, 122]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_223954__786.json0.0missing{\n "num_gpu": 99\n}missing
642Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_224011__46500.016.67350[151, 406]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_224011__465.json50.0missing{\n "num_gpu": 99\n}missing
643Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_224017__65900.05.264890[151, 115]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_224017__659.json0.0missing{\n "num_gpu": 99\n}missing
644Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_224022__59600.05.022280[151, 109]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_224022__596.json50.0missing{\n "num_gpu": 99\n}missing
645Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_223803__11700.022.36780[331, 492]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223803__117.json25.0missing{\n "num_gpu": 99\n}missing
646Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223830__11700.026.9340[331, 622]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223830__117.json50.0missing{\n "num_gpu": 99\n}missing
647Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223848__99800.018.45230[331, 417]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223848__998.json50.0missing{\n "num_gpu": 99\n}missing
648Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223909__72600.020.50140[331, 467]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223909__726.json50.0missing{\n "num_gpu": 99\n}missing
649Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223938__55200.028.70540[331, 664]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223938__552.json50.0missing{\n "num_gpu": 99\n}missing
650Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_224434__41300.023.06810[418, 512]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224434__413.json50.0missing{\n "num_gpu": 99\n}missing
651Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_224459__90800.024.57780[418, 548]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224459__908.json25.0missing{\n "num_gpu": 99\n}missing
652Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_224521__97500.022.23180[418, 492]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224521__975.json25.0missing{\n "num_gpu": 99\n}missing
653Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_224550__87800.028.75740[418, 647]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224550__878.json25.0missing{\n "num_gpu": 99\n}missing
654Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_224605__50600.015.12880[418, 320]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224605__506.json50.0missing{\n "num_gpu": 99\n}missing
655Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_224211__74600.037.10380[416, 844]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224211__746.json50.0missing{\n "num_gpu": 99\n}missing
656Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_224233__75600.021.13160[416, 469]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224233__756.json50.0missing{\n "num_gpu": 99\n}missing
657Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_224302__42500.028.56960[416, 646]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224302__425.json0.0missing{\n "num_gpu": 99\n}missing
658Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_224333__29100.030.81440[416, 699]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224333__291.json25.0missing{\n "num_gpu": 99\n}missing
659Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_224411__41500.038.08310[416, 867]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224411__415.json0.0missing{\n "num_gpu": 99\n}missing
660Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_115844__73800.015.7560[110, 279]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115844__738.json0.0missing{\n "num_gpu": 99\n}missing
661Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_115901__34900.017.5760[110, 307]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115901__349.json25.0missing{\n "num_gpu": 99\n}missing
662Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_215211__43000.034.13860[110, 622]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_215211__430.json50.0missing{\n "num_gpu": 99\n}missing
663Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_115822__12800.05.627520[151, 88]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115822__128.json50.0missing{\n "num_gpu": 99\n}missing
664Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_115828__79800.06.034320[151, 95]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115828__798.json0.0missing{\n "num_gpu": 99\n}missing
665Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_215137__39100.05.566760[151, 89]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_215137__391.json0.0missing{\n "num_gpu": 99\n}missing
666Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_115746__60500.050.21330[331, 855]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115746__605.json0.0missing{\n "num_gpu": 99\n}missing
667Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_115816__82200.029.33490[331, 496]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115816__822.json50.0missing{\n "num_gpu": 99\n}missing
668Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_215132__98000.038.87990[331, 514]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215132__980.json25.0missing{\n "num_gpu": 99\n}missing
669Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_120102__13100.018.23930[418, 288]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120102__131.json0.0missing{\n "num_gpu": 99\n}missing
670Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120131__26200.028.94660[418, 480]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120131__262.json50.0missing{\n "num_gpu": 99\n}missing
671Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_215332__84700.042.08640[418, 715]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215332__847.json0.0missing{\n "num_gpu": 99\n}missing
672Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_120006__94100.033.86020[416, 558]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120006__941.json25.0missing{\n "num_gpu": 99\n}missing
673Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120044__87000.037.38070[416, 631]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120044__870.json50.0missing{\n "num_gpu": 99\n}missing
674Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_215249__37600.037.29720[416, 633]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_215249__376.json25.0missing{\n "num_gpu": 99\n}missing
675Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_102046__38800.039.74571[116, 226]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_102046__388.json62.5missing{\n "num_gpu": 99\n}missing
676Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_102132__79800.045.49510[116, 261]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_102132__798.json50.0missing{\n "num_gpu": 99\n}missing
677Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_102204__52350.031.40112[116, 175]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_102204__523.json100.0missing{\n "num_gpu": 99\n}missing
678Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142103__62400.056.35270[116, 325]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142103__624.json50.0missing{\n "num_gpu": 99\n}missing
679Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142156__42400.052.5290[116, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142156__424.json50.0missing{\n "num_gpu": 99\n}missing
680Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_101845__46800.014.18090[155, 64]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_101845__468.json0.0missing{\n "num_gpu": 99\n}missing
681Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_101937__78800.052.55250[155, 298]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_101937__788.json50.0missing{\n "num_gpu": 99\n}missing
682Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_102006__23500.028.34060[155, 151]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_102006__235.json0.0missing{\n "num_gpu": 99\n}missing
683Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_141947__16200.019.35160[155, 95]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_141947__162.json0.0missing{\n "num_gpu": 99\n}missing
684Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_142007__69800.020.44960[155, 102]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_142007__698.json0.0missing{\n "num_gpu": 99\n}missing
685Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_101623__80200.0142.620[343, 760]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101623__802.json50.0missing{\n "num_gpu": 99\n}missing
686Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_101708__24100.043.59890[343, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101708__241.json0.0missing{\n "num_gpu": 99\n}missing
687Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_101830__12500.082.45440[343, 440]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101830__125.json50.0missing{\n "num_gpu": 99\n}missing
688Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_141740__49400.0136.5690[343, 746]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_141740__494.json50.0missing{\n "num_gpu": 99\n}missing
689Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_141927__89600.0106.2210[343, 574]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_141927__896.json50.0missing{\n "num_gpu": 99\n}missing
690Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_102758__75850.062.26282[429, 298]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_102758__758.json100.0missing{\n "num_gpu": 99\n}missing
691Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_102849__19200.050.67560[429, 232]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_102849__192.json50.0missing{\n "num_gpu": 99\n}missing
692Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_102917__79100.027.75080[429, 97]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_102917__791.json50.0missing{\n "num_gpu": 99\n}missing
693Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_142501__39940.060.28492[429, 289]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_142501__399.json95.0missing{\n "num_gpu": 99\n}missing
694Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_142631__29600.089.42770[429, 458]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_142631__296.json50.0missing{\n "num_gpu": 99\n}missing
695Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_102346__87200.0101.6440[427, 531]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_102346__872.json50.0missing{\n "num_gpu": 99\n}missing
696Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_102500__54600.073.52090[427, 369]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_102500__546.json50.0missing{\n "num_gpu": 99\n}missing
697Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_102654__25000.0114.1230[427, 576]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_102654__250.json50.0missing{\n "num_gpu": 99\n}missing
698Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_142248__20600.051.14020[427, 236]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_142248__206.json50.0missing{\n "num_gpu": 99\n}missing
699Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_142400__45250.071.52772[427, 355]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_142400__452.json100.0missing{\n "num_gpu": 99\n}missing
700Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_213840__72600.022.85240[1, 669]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_213840__726.json25.0missingmissingmissing
701Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_213858__64000.018.30560[1, 547]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_213858__640.json25.0missingmissingmissing
702Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231224_233946__78200.010.79870[119, 263]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_233946__782.json50.0missing{\n "num_gpu": 99\n}missing
703Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231224_233957__12600.010.40820[119, 253]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_233957__126.json50.0missing{\n "num_gpu": 99\n}missing
704Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231226_214205__55700.09.748590[119, 236]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_214205__557.json50.0missing{\n "num_gpu": 99\n}missing
705Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_213759__42000.013.43790[1, 406]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213759__420.json25.0missingmissingmissing
706Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_213803__11500.04.492140[1, 142]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213803__115.json0.0missingmissingmissing
707Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233928__72100.04.703850[160, 101]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233928__721.json50.0missing{\n "num_gpu": 99\n}missing
708Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233935__16600.06.907870[160, 158]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233935__166.json50.0missing{\n "num_gpu": 99\n}missing
709Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_214156__58000.04.737350[160, 102]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_214156__580.json50.0missing{\n "num_gpu": 99\n}missing
710Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_213723__58800.034.31220[1, 906]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213723__588.json25.0missingmissingmissing
711Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213737__82900.013.71690[1, 392]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213737__829.json0.0missingmissingmissing
712Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231224_233904__19300.022.02110[340, 349]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233904__193.json25.0missing{\n "num_gpu": 99\n}missing
713Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231224_233923__53940.018.30412[340, 414]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233923__539.json95.0missing{\n "num_gpu": 99\n}missing
714Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_214151__74700.024.90210[340, 430]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_214151__747.json50.0missing{\n "num_gpu": 99\n}missing
715Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_214140__83900.024.50330[1, 653]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214140__839.json25.0missingmissingmissing
716Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_214147__96400.07.211360[1, 206]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214147__964.json0.0missingmissingmissing
717Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231224_234106__31100.014.12380[427, 296]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234106__311.json0.0missing{\n "num_gpu": 99\n}missing
718Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_234123__29000.016.47290[427, 354]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234123__290.json50.0missing{\n "num_gpu": 99\n}missing
719Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231226_214244__62200.019.9760[427, 438]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_214244__622.json25.0missing{\n "num_gpu": 99\n}missing
720Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_214023__42400.019.57820[1, 532]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_214023__424.json25.0missingmissingmissing
721Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_214052__22800.029.29560[1, 768]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_214052__228.json0.0missingmissingmissing
722Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_234037__73400.017.57820[425, 381]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_234037__734.json50.0missing{\n "num_gpu": 99\n}missing
723Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_234052__28500.014.36030[425, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_234052__285.json50.0missing{\n "num_gpu": 99\n}missing
724Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_214224__91300.018.10370[425, 393]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_214224__913.json50.0missing{\n "num_gpu": 99\n}missing
725Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTfalsefalse520231213_231953__59600.019.49050[112, 556]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_231953__596.json0.0missingmissingmissing
726Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTtruetrue520231224_224416__98600.07.620960[117, 235]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_224416__986.json50.0missing{\n "num_gpu": 99\n}missing
727Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTtruetrue520231224_224422__88900.05.867760[117, 177]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_224422__889.json50.0missing{\n "num_gpu": 99\n}missing
728Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTtruetrue520231226_211733__57600.09.624390[117, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_211733__576.json50.0missing{\n "num_gpu": 99\n}missing
729Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231213_231934__96300.015.0210[141, 420]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_231934__963.json0.0missingmissingmissing
730Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231224_224358__55600.010.63170[158, 327]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_224358__556.json50.0missing{\n "num_gpu": 99\n}missing
731Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231224_224408__49900.09.635231[158, 296]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_224408__499.json62.5missing{\n "num_gpu": 99\n}missing
732Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_211723__89800.06.368021[158, 189]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_211723__898.json62.5missing{\n "num_gpu": 99\n}missing
733Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231213_231919__84400.021.11510[311, 516]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231919__844.json25.0missingmissingmissing
734Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231224_224329__34100.025.70760[338, 593]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224329__341.json25.0missing{\n "num_gpu": 99\n}missing
735Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231224_224346__77900.017.31670[338, 498]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224346__779.json50.0missing{\n "num_gpu": 99\n}missing
736Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_211716__84800.018.3340[338, 374]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211716__848.json50.0missing{\n "num_gpu": 99\n}missing
737Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231213_232046__17200.017.62450[11, 475]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232046__172.json0.0missingmissingmissing
738Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_224534__73000.021.33820[425, 599]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224534__730.json50.0missing{\n "num_gpu": 99\n}missing
739Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_224547__73400.012.8720[425, 343]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224547__734.json50.0missing{\n "num_gpu": 99\n}missing
740Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231226_211747__23700.02.449850[425, 15]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211747__237.json0.0missing{\n "num_gpu": 99\n}missing
741Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231213_232028__38400.022.30440[412, 501]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_232028__384.json25.0missingmissingmissing
742Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231224_224456__34800.017.40950[423, 484]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_224456__348.json50.0missing{\n "num_gpu": 99\n}missing
743Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231224_224512__38600.016.46440[423, 456]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_224512__386.json0.0missing{\n "num_gpu": 99\n}missing
744Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_211744__20240.010.47292[423, 272]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_211744__202.json95.0missing{\n "num_gpu": 99\n}missing
745Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTtruefalse520231213_233249__10600.013.98830[112, 402]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231213_233249__106.json25.0missingmissingmissing
746Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231224_231038__29500.021.42860[115, 382]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231224_231038__295.json0.0missing{\n "num_gpu": 99\n}missing
747Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231224_231054__61200.015.94520[115, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231224_231054__612.json0.0missing{\n "num_gpu": 99\n}missing
748Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231226_212718__77800.02.963160[115, 37]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231226_212718__778.json0.0missing{\n "num_gpu": 99\n}missing
749Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTtruefalse520231213_233235__67300.08.375480[141, 227]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231213_233235__673.json25.0missingmissingmissing
750Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231224_231008__34000.07.602820[154, 120]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_231008__340.json0.0missing{\n "num_gpu": 99\n}missing
751Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231224_231017__39200.08.544550[154, 137]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_231017__392.json0.0missing{\n "num_gpu": 99\n}missing
752Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_212715__46500.08.506670[154, 136]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_212715__465.json0.0missing{\n "num_gpu": 99\n}missing
753Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231213_233227__41200.026.17470[311, 644]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233227__412.json25.0missingmissingmissing
754Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231224_230944__45500.032.05090[324, 354]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230944__455.json0.0missing{\n "num_gpu": 99\n}missing
755Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231224_231001__15900.017.00120[324, 260]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_231001__159.json0.0missing{\n "num_gpu": 99\n}missing
756Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_212706__28600.022.63130[324, 199]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212706__286.json0.0missing{\n "num_gpu": 99\n}missing
757Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231213_233354__78700.015.81570[11, 429]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233354__787.json50.0missingmissingmissing
758Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231224_231257__88200.028.04750[418, 435]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_231257__882.json0.0missing{\n "num_gpu": 99\n}missing
759Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231224_231324__84800.027.08710[418, 418]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_231324__848.json0.0missing{\n "num_gpu": 99\n}missing
760Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231226_212834__33700.042.80940[418, 685]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212834__337.json0.0missing{\n "num_gpu": 99\n}missing
761Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTfalsefalse520231213_233338__86800.024.7940[412, 564]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231213_233338__868.json0.0missingmissingmissing
762Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTtruetrue520231224_231205__71400.037.48360[415, 598]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_231205__714.json50.0missing{\n "num_gpu": 99\n}missing
763Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTtruetrue520231224_231229__97100.023.25190[415, 356]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_231229__971.json50.0missing{\n "num_gpu": 99\n}missing
764Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_212751__68300.033.88620[415, 540]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_212751__683.json0.0missing{\n "num_gpu": 99\n}missing
765Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_214326__95400.015.0610[112, 435]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_214326__954.json25.0missingmissingmissing
766Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_214344__97100.017.78680[1, 533]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_214344__971.json0.0missingmissingmissing
767Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_214407__15100.023.11370[1, 676]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_214407__151.json25.0missingmissingmissing
768Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231224_234221__55100.024.06570[112, 883]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_234221__551.json0.0missing{\n "num_gpu": 99\n}missing
769Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231224_234233__45800.011.63010[112, 441]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_234233__458.json0.0missing{\n "num_gpu": 99\n}missing
770Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_214306__92200.015.68480[1, 469]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_214306__922.json0.0missingmissingmissing
771Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_214311__61100.04.921290[1, 155]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_214311__611.json0.0missingmissingmissing
772Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231224_234152__30200.015.80270[149, 586]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_234152__302.json0.0missing{\n "num_gpu": 99\n}missing
773Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231224_234157__33900.05.013820[149, 182]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_234157__339.json0.0missing{\n "num_gpu": 99\n}missing
774Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_214323__91500.029.02510[149, 1035]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_214323__915.json0.0missing{\n "num_gpu": 99\n}missing
775Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_214224__85500.014.70610[1, 419]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214224__855.json0.0missingmissingmissing
776Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_214240__88400.015.43390[1, 438]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214240__884.json0.0missingmissingmissing
777Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231224_234132__89400.08.793920[318, 157]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234132__894.json0.0missing{\n "num_gpu": 99\n}missing
778Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231224_234137__26700.04.356880[318, 130]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234137__267.json0.0missing{\n "num_gpu": 99\n}missing
779Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_214254__22000.09.132630[318, 179]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_214254__220.json0.0missing{\n "num_gpu": 99\n}missing
780Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_214633__20800.021.08810[11, 564]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214633__208.json25.0missingmissingmissing
781Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_214651__48000.017.8860[1, 489]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214651__480.json25.0missingmissingmissing
782Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_214708__99900.017.29440[1, 474]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214708__999.json25.0missingmissingmissing
783Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231224_234340__18500.010.51590[401, 340]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234340__185.json50.0missing{\n "num_gpu": 99\n}missing
784Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231224_234349__72000.08.877950[401, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234349__720.json0.0missing{\n "num_gpu": 99\n}missing
785Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_214530__93800.023.47960[412, 533]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_214530__938.json25.0missingmissingmissing
786Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_214554__57100.023.86730[1, 638]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_214554__571.json25.0missingmissingmissing
787Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_214612__40000.017.7540[1, 486]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_214612__400.json25.0missingmissingmissing
788Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231224_234326__79000.026.21330[398, 872]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_234326__790.json25.0missing{\n "num_gpu": 99\n}missing
789Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231224_234329__78400.03.592310[398, 86]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_234329__784.json50.0missing{\n "num_gpu": 99\n}missing
790Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTtruefalse520231213_233436__89800.015.1240[112, 434]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231213_233436__898.json25.0missingmissingmissing
791Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTtruetrue520231224_231743__43740.054.31852[123, 416]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_231743__437.json95.0missing{\n "num_gpu": 99\n}missing
792Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTtruetrue520231224_231818__63550.033.65942[123, 252]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_231818__635.json100.0missing{\n "num_gpu": 99\n}missing
793Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTfalsefalse520231226_213108__69200.033.05070[123, 246]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_213108__692.json0.0missing{\n "num_gpu": 99\n}missing
794Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231213_233421__63600.04.658780[141, 115]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231213_233421__636.json50.0missingmissingmissing
795Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231224_231559__40650.023.51172[162, 160]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_231559__406.json100.0missing{\n "num_gpu": 99\n}missing
796Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231224_231649__99300.049.3150[162, 365]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_231649__993.json50.0missing{\n "num_gpu": 99\n}missing
797Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_213034__97300.045.13720[162, 331]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_213034__973.json50.0missing{\n "num_gpu": 99\n}missing
798Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231213_233416__66100.021.04270[311, 513]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233416__661.json0.0missingmissingmissing
799Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231224_231454__31100.090.62690[332, 477]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_231454__311.json50.0missing{\n "num_gpu": 99\n}missing
800Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231224_231535__88000.040.21750[332, 263]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_231535__880.json25.0missing{\n "num_gpu": 99\n}missing
801Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_212949__37650.074.54872[332, 366]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212949__376.json100.0missing{\n "num_gpu": 99\n}missing
802Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231213_233540__54800.020.58670[11, 549]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233540__548.json25.0missingmissingmissing
803Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231224_232147__40550.053.57222[426, 346]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_232147__405.json100.0missing{\n "num_gpu": 99\n}missing
804Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231224_232252__49400.064.97990[426, 433]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_232252__494.json25.0missing{\n "num_gpu": 99\n}missing
805Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231226_213231__40350.045.08212[426, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_213231__403.json100.0missing{\n "num_gpu": 99\n}missing
806Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse520231213_233520__72300.025.25150[412, 575]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231213_233520__723.json0.0missingmissingmissing
807Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231224_232005__48400.025.97330[423, 134]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_232005__484.json50.0missing{\n "num_gpu": 99\n}missing
808Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231224_232053__99100.047.97160[423, 305]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_232053__991.json25.0missing{\n "num_gpu": 99\n}missing
809Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_213146__86650.037.64512[423, 225]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_213146__866.json100.0missing{\n "num_gpu": 99\n}missing
810Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_212733__75200.015.72990[1, 476]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_212733__752.json25.0missingmissingmissing
811Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_212748__11400.015.02610[1, 456]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_212748__114.json25.0missingmissingmissing
812Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231224_233432__34600.018.72860[119, 310]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_233432__346.json0.0missing{\n "num_gpu": 99\n}missing
813Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231224_233446__95900.013.57030[119, 221]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_233446__959.json50.0missing{\n "num_gpu": 99\n}missing
814Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231226_213853__91900.013.27540[119, 216]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_213853__919.json0.0missing{\n "num_gpu": 99\n}missing
815Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_212648__35600.011.0220[1, 337]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212648__356.json0.0missingmissingmissing
816Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_212656__37500.08.734310[1, 270]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212656__375.json25.0missingmissingmissing
817Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233358__84400.013.73360[160, 219]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233358__844.json50.0missing{\n "num_gpu": 99\n}missing
818Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231224_233413__35900.015.11580[160, 243]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233413__359.json0.0missing{\n "num_gpu": 99\n}missing
819Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_213839__48700.09.820330[160, 151]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_213839__487.json50.0missing{\n "num_gpu": 99\n}missing
820Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_212551__20500.09.933040[1, 289]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212551__205.json0.0missingmissingmissing
821Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_212617__79500.025.81430[1, 703]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212617__795.json25.0missingmissingmissing
822Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231224_233326__93600.028.08320[340, 262]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233326__936.json0.0missing{\n "num_gpu": 99\n}missing
823Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231224_233344__65900.018.84530[340, 276]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233344__659.json0.0missing{\n "num_gpu": 99\n}missing
824Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_213829__15600.030.69230[340, 327]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_213829__156.json0.0missing{\n "num_gpu": 99\n}missing
825Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_213040__60900.028.0870[1, 739]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213040__609.json25.0missingmissingmissing
826Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_213041__20200.01.40050[1, 41]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213041__202.json0.0missingmissingmissing
827Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231224_233607__84600.017.03520[427, 231]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233607__846.json25.0missing{\n "num_gpu": 99\n}missing
828Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231224_233624__40500.016.26120[427, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233624__405.json0.0missing{\n "num_gpu": 99\n}missing
829Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231226_213937__21600.024.50570[427, 355]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_213937__216.json25.0missing{\n "num_gpu": 99\n}missing
830Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_212929__96900.024.75690[1, 660]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212929__969.json25.0missingmissingmissing
831Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_212953__31400.023.42190[1, 627]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212953__314.json25.0missingmissingmissing
832Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_233534__31100.021.00670[425, 297]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233534__311.json50.0missing{\n "num_gpu": 99\n}missing
833Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_233550__15500.016.620[425, 224]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233550__155.json50.0missing{\n "num_gpu": 99\n}missing
834Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231226_213913__90000.020.15650[425, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_213913__900.json0.0missing{\n "num_gpu": 99\n}missing
835Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTtruefalse520231213_233053__74800.013.5930[112, 391]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231213_233053__748.json25.0missingmissingmissing
836Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTfalsefalse520231224_230823__90400.05.815420[118, 321]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_230823__904.json0.0missing{\n "num_gpu": 99\n}missing
837Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTtruetrue520231224_230826__95200.03.782880[118, 207]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_230826__952.json50.0missing{\n "num_gpu": 99\n}missing
838Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTtruetrue520231226_212629__16900.03.31260[118, 180]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_212629__169.json50.0missing{\n "num_gpu": 99\n}missing
839Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231213_233040__79100.010.84570[141, 300]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231213_233040__791.json25.0missingmissingmissing
840Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231224_230812__43400.02.778180[155, 142]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_230812__434.json0.0missing{\n "num_gpu": 99\n}missing
841Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231224_230817__10800.04.432170[155, 236]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_230817__108.json0.0missing{\n "num_gpu": 99\n}missing
842Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231226_212626__92500.02.257920[155, 112]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_212626__925.json0.0missing{\n "num_gpu": 99\n}missing
843Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231213_233029__96000.021.25060[311, 519]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233029__960.json0.0missingmissingmissing
844Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231224_230802__78100.08.819380[321, 270]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230802__781.json0.0missing{\n "num_gpu": 99\n}missing
845Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231224_230810__71700.08.060670[321, 385]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230810__717.json0.0missing{\n "num_gpu": 99\n}missing
846Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231226_212624__32900.018.55750[321, 766]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212624__329.json25.0missing{\n "num_gpu": 99\n}missing
847Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231213_233201__83300.025.66710[11, 674]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233201__833.json25.0missingmissingmissing
848Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231224_230900__54900.08.136010[405, 367]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230900__549.json50.0missing{\n "num_gpu": 99\n}missing
849Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231224_230912__22500.011.32150[405, 522]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230912__225.json0.0missing{\n "num_gpu": 99\n}missing
850Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_212643__40900.06.622030[405, 290]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212643__409.json50.0missing{\n "num_gpu": 99\n}missing
851Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231213_233134__86100.021.86030[412, 490]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231213_233134__861.json50.0missingmissingmissing
852Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231224_230844__93300.07.248210[403, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_230844__933.json50.0missing{\n "num_gpu": 99\n}missing
853Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231224_230852__41400.07.950470[403, 358]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_230852__414.json0.0missing{\n "num_gpu": 99\n}missing
854Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_212637__88500.07.487840[403, 335]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_212637__885.json50.0missing{\n "num_gpu": 99\n}missing
855Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruefalse520231213_232142__37100.017.24030[112, 494]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_232142__371.json25.0missingmissingmissing
856Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruetrue520231224_224702__57000.010.34470[119, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_224702__570.json50.0missing{\n "num_gpu": 99\n}missing
857Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruetrue520231224_224713__99600.011.19540[119, 351]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_224713__996.json50.0missing{\n "num_gpu": 99\n}missing
858Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruetrue520231226_211838__35900.06.862970[119, 210]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_211838__359.json50.0missing{\n "num_gpu": 99\n}missing
859Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231213_232124__24800.017.42090[141, 487]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_232124__248.json0.0missingmissingmissing
860Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_224643__37000.011.91720[160, 369]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_224643__370.json50.0missing{\n "num_gpu": 99\n}missing
861Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_224651__37200.07.368290[160, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_224651__372.json50.0missing{\n "num_gpu": 99\n}missing
862Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_211831__29700.021.84220[160, 681]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_211831__297.json50.0missing{\n "num_gpu": 99\n}missing
863Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231213_232107__91400.020.83240[311, 509]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232107__914.json25.0missingmissingmissing
864Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231224_224617__47600.030.78150[340, 735]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224617__476.json25.0missing{\n "num_gpu": 99\n}missing
865Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231224_224631__18700.014.07190[340, 400]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224631__187.json0.0missing{\n "num_gpu": 99\n}missing
866Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231226_211809__92300.022.27160[340, 495]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211809__923.json0.0missing{\n "num_gpu": 99\n}missing
867Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231213_232239__13000.020.37450[11, 544]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232239__130.json50.0missingmissingmissing
868Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231224_224817__59400.016.75720[427, 463]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224817__594.json25.0missing{\n "num_gpu": 99\n}missing
869Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231224_224838__37700.020.82250[427, 587]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224838__377.json50.0missing{\n "num_gpu": 99\n}missing
870Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_211911__65100.013.58880[427, 368]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211911__651.json50.0missing{\n "num_gpu": 99\n}missing
871Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231213_232219__38500.027.75080[412, 637]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_232219__385.json25.0missingmissingmissing
872Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_224745__58700.013.45770[425, 363]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_224745__587.json50.0missing{\n "num_gpu": 99\n}missing
873Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_224800__82400.014.56160[425, 397]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_224800__824.json50.0missing{\n "num_gpu": 99\n}missing
874Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231226_211858__69200.019.4810[425, 548]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_211858__692.json25.0missing{\n "num_gpu": 99\n}missing
875Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruefalse520231213_232326__50400.020.51420[112, 584]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_232326__504.json25.0missingmissingmissing
876Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruetrue520231224_225221__79300.037.58880[116, 273]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_225221__793.json50.0missing{\n "num_gpu": 99\n}missing
877Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruefalse520231224_225301__99600.039.64530[116, 289]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_225301__996.json25.0missing{\n "num_gpu": 99\n}missing
878Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruefalse520231226_212155__97300.049.94780[116, 368]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_212155__973.json25.0missing{\n "num_gpu": 99\n}missing
879Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231213_232305__26300.010.22190[141, 282]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_232305__263.json0.0missingmissingmissing
880Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231224_225120__52100.033.82581[155, 238]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_225120__521.json62.5missing{\n "num_gpu": 99\n}missing
881Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231224_225143__50100.023.30890[155, 157]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_225143__501.json0.0missing{\n "num_gpu": 99\n}missing
882Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_212105__91000.030.0230[155, 210]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_212105__910.json50.0missing{\n "num_gpu": 99\n}missing
883Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231213_232255__45800.015.71840[311, 373]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232255__458.json0.0missingmissingmissing
884Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231224_224932__14100.054.12860[343, 164]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224932__141.json25.0missing{\n "num_gpu": 99\n}missing
885Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231224_225045__45100.072.78190[343, 490]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_225045__451.json25.0missing{\n "num_gpu": 99\n}missing
886Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231226_212035__51400.082.94530[343, 404]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212035__514.json25.0missing{\n "num_gpu": 99\n}missing
887Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231213_232434__58500.017.37040[11, 468]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232434__585.json25.0missingmissingmissing
888Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231224_225700__94500.052.24430[429, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_225700__945.json25.0missing{\n "num_gpu": 99\n}missing
889Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231224_225826__33100.085.50140[429, 562]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_225826__331.json50.0missing{\n "num_gpu": 99\n}missing
890Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231226_212329__46100.041.37520[429, 243]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212329__461.json25.0missing{\n "num_gpu": 99\n}missing
891Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTfalsefalse520231213_232416__61800.031.8150[412, 733]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_232416__618.json0.0missingmissingmissing
892Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_225518__57400.062.53520[427, 397]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_225518__574.json25.0missing{\n "num_gpu": 99\n}missing
893Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_225608__38100.049.38160[427, 301]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_225608__381.json25.0missing{\n "num_gpu": 99\n}missing
894Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_212247__76900.052.01330[427, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_212247__769.json50.0missing{\n "num_gpu": 99\n}missing
895Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTfalsefalse520231213_234202__29200.014.48850[60, 435]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231213_234202__292.json0.0missingmissingmissing
896Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTtruetrue520231225_000132__11500.013.94090[68, 251]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_000132__115.json50.0missing{\n "num_gpu": 99\n}missing
897Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTtruetrue520231225_000155__63800.023.00820[68, 420]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_000155__638.json50.0missing{\n "num_gpu": 99\n}missing
898Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTtruetrue520231226_220105__49600.012.9260[68, 233]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_220105__496.json50.0missing{\n "num_gpu": 99\n}missing
899Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231213_234148__62100.06.819690[90, 196]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231213_234148__621.json50.0missingmissingmissing
900Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_000114__85300.07.303390[107, 120]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_000114__853.json50.0missing{\n "num_gpu": 99\n}missing
901Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_000118__48800.03.536730[107, 48]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_000118__488.json50.0missing{\n "num_gpu": 99\n}missing
902Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_220052__88200.03.356660[107, 45]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_220052__882.json50.0missing{\n "num_gpu": 99\n}missing
903Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231213_234141__15900.014.35330[201, 379]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234141__159.json50.0missingmissingmissing
904Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_000058__60600.014.78810[219, 57]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000058__606.json0.0missing{\n "num_gpu": 99\n}missing
905Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_000107__34000.08.90920[219, 134]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000107__340.json0.0missing{\n "num_gpu": 99\n}missing
906Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_220048__68800.012.87220[219, 33]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220048__688.json0.0missing{\n "num_gpu": 99\n}missing
907Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231213_234257__42200.017.8140[11, 487]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234257__422.json25.0missingmissingmissing
908Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231225_000257__38100.08.878210[372, 107]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000257__381.json0.0missing{\n "num_gpu": 99\n}missing
909Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_000318__39600.021.02020[372, 325]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000318__396.json50.0missing{\n "num_gpu": 99\n}missing
910Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_220138__48500.011.79430[372, 161]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220138__485.json50.0missing{\n "num_gpu": 99\n}missing
911Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231213_234239__74900.022.59050[361, 531]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231213_234239__749.json25.0missingmissingmissing
912Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231225_000229__76600.026.16960[369, 416]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_000229__766.json25.0missing{\n "num_gpu": 99\n}missing
913Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_000248__17700.019.11940[369, 291]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_000248__177.json50.0missing{\n "num_gpu": 99\n}missing
914Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231226_220126__37700.021.45020[369, 335]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_220126__377.json25.0missing{\n "num_gpu": 99\n}missing
915Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonInJulia1SHOTtruefalse520231213_234344__98400.013.68660[60, 412]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__InJulia__1SHOT__20231213_234344__984.json25.0missingmissingmissing
916Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonInJulia1SHOTfalsefalse520231225_000411__22600.029.64180[42, 546]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_000411__226.json0.0missing{\n "num_gpu": 99\n}missing
917Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonInJulia1SHOTfalsefalse520231225_000443__30000.031.87640[42, 586]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_000443__300.json0.0missing{\n "num_gpu": 99\n}missing
918Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231213_234330__81700.015.9080[90, 464]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231213_234330__817.json50.0missingmissingmissing
919Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_000336__69200.04.160030[44, 70]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_000336__692.json0.0missing{\n "num_gpu": 99\n}missing
920Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_000342__55500.05.931730[44, 104]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_000342__555.json0.0missing{\n "num_gpu": 99\n}missing
921Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231213_234314__20700.017.4420[201, 464]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234314__207.json50.0missingmissingmissing
922Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_000331__81900.00.8772730[94, 1]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000331__819.json0.0missing{\n "num_gpu": 99\n}missing
923Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_000331__99100.012.57770[94, 30]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000331__991.json0.0missing{\n "num_gpu": 99\n}missing
924Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231213_234443__68510.019.50671[11, 530]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234443__685.json67.5missingmissingmissing
925Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_000512__61700.02.311920[61, 34]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000512__617.json0.0missing{\n "num_gpu": 99\n}missing
926Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_000515__59100.02.84280[61, 44]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000515__591.json0.0missing{\n "num_gpu": 99\n}missing
927Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231213_234424__54900.021.33980[361, 500]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231213_234424__549.json50.0missingmissingmissing
928Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_000503__70600.04.327420[58, 73]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_000503__706.json0.0missing{\n "num_gpu": 99\n}missing
929Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_000510__52600.06.564860[58, 116]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_000510__526.json0.0missing{\n "num_gpu": 99\n}missing
930Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_214833__41200.011.06370[1, 348]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_214833__412.json0.0missingmissingmissing
931Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_214848__87700.015.14020[1, 467]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_214848__877.json0.0missingmissingmissing
932Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_002425__45210.060.59362[60, 370]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_002425__452.json80.0missing{\n "num_gpu": 99\n}missing
933Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_002515__77400.049.58210[60, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_002515__774.json50.0missing{\n "num_gpu": 99\n}missing
934Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_221124__98650.027.01392[60, 162]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_221124__986.json100.0missing{\n "num_gpu": 99\n}missing
935Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_214807__67200.07.942080[1, 251]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_214807__672.json25.0missingmissingmissing
936Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_214811__77100.04.510610[1, 145]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_214811__771.json25.0missingmissingmissing
937Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_002233__91750.025.70162[101, 143]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_002233__917.json100.0missing{\n "num_gpu": 99\n}missing
938Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_002324__86800.050.97790[101, 301]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_002324__868.json0.0missing{\n "num_gpu": 99\n}missing
939Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_221057__85100.022.72130[101, 125]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221057__851.json0.0missing{\n "num_gpu": 99\n}missing
940Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_214737__54800.013.39370[1, 397]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214737__548.json25.0missingmissingmissing
941Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_214750__19300.012.81790[1, 381]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214750__193.json0.0missingmissingmissing
942Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_002125__53310.064.22272[213, 193]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_002125__533.json80.0missing{\n "num_gpu": 99\n}missing
943Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_002207__79400.041.31040[213, 223]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_002207__794.json0.0missing{\n "num_gpu": 99\n}missing
944Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_221034__27750.073.80192[213, 276]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221034__277.json100.0missing{\n "num_gpu": 99\n}missing
945Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215104__86100.014.610[1, 411]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215104__861.json25.0missingmissingmissing
946Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215117__60800.012.81980[1, 363]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215117__608.json25.0missingmissingmissing
947Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003016__32010.069.30582[389, 361]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003016__320.json80.0missing{\n "num_gpu": 99\n}missing
948Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003052__75000.035.72670[389, 159]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003052__750.json50.0missing{\n "num_gpu": 99\n}missing
949Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_221302__55750.033.02222[389, 143]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221302__557.json100.0missing{\n "num_gpu": 99\n}missing
950Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215014__12000.021.39640[1, 586]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215014__120.json25.0missingmissingmissing
951Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215033__12900.019.25190[1, 532]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215033__129.json25.0missingmissingmissing
952Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_002808__55350.064.29092[387, 331]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_002808__553.json100.0missing{\n "num_gpu": 99\n}missing
953Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_002906__81150.057.93432[387, 293]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_002906__811.json100.0missing{\n "num_gpu": 99\n}missing
954Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_221229__16950.064.43662[387, 333]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221229__169.json100.0missing{\n "num_gpu": 99\n}missing
955Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231226_221918__15400.09.57990[60, 373]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_221918__154.json25.0missing{\n "num_gpu": 99\n}missing
956Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_102959__39600.09.226740[60, 357]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_102959__396.json0.0missing{\n "num_gpu": 99\n}missing
957Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_103007__18500.07.458850[60, 288]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_103007__185.json25.0missing{\n "num_gpu": 99\n}missing
958Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_103016__93000.08.733250[60, 339]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_103016__930.json0.0missing{\n "num_gpu": 99\n}missing
959Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_221908__41000.07.927270[97, 301]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_221908__410.json0.0missing{\n "num_gpu": 99\n}missing
960Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_102939__89200.06.066910[97, 228]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_102939__892.json0.0missing{\n "num_gpu": 99\n}missing
961Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_102945__55200.06.225730[97, 233]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_102945__552.json50.0missing{\n "num_gpu": 99\n}missing
962Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_102950__99300.04.744580[97, 174]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_102950__993.json50.0missing{\n "num_gpu": 99\n}missing
963Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_221900__72600.08.983860[205, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221900__726.json0.0missing{\n "num_gpu": 99\n}missing
964Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_102924__10200.07.116260[205, 126]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_102924__102.json0.0missing{\n "num_gpu": 99\n}missing
965Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_102927__35800.02.960170[205, 91]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_102927__358.json0.0missing{\n "num_gpu": 99\n}missing
966Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_102933__48400.05.473010[205, 187]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_102933__484.json0.0missing{\n "num_gpu": 99\n}missing
967Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_221935__96600.08.343770[349, 273]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221935__966.json0.0missing{\n "num_gpu": 99\n}missing
968Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_103050__51900.08.179750[349, 261]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_103050__519.json0.0missing{\n "num_gpu": 99\n}missing
969Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_103103__75700.012.06940[349, 406]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_103103__757.json0.0missing{\n "num_gpu": 99\n}missing
970Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_103112__61200.09.862140[349, 326]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_103112__612.json0.0missing{\n "num_gpu": 99\n}missing
971Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231226_221927__71400.08.800650[346, 290]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_221927__714.json25.0missing{\n "num_gpu": 99\n}missing
972Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_103027__93800.011.65350[346, 389]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_103027__938.json0.0missing{\n "num_gpu": 99\n}missing
973Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_103033__23000.06.067420[346, 188]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_103033__230.json0.0missing{\n "num_gpu": 99\n}missing
974Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_103042__59210.08.84582[346, 289]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_103042__592.json80.0missing{\n "num_gpu": 99\n}missing
975Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTfalsefalse520231213_233618__24800.013.23180[60, 399]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231213_233618__248.json0.0missingmissingmissing
976Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTfalsefalse520231224_234455__22800.013.16990[60, 398]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231224_234455__228.json0.0missing{\n "num_gpu": 99\n}missing
977Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTfalsefalse520231224_234506__26700.010.94980[1, 344]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231224_234506__267.json0.0missing{\n "num_gpu": 99\n}missing
978Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTtruefalse520231226_215449__13400.08.041320[60, 248]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231226_215449__134.json25.0missing{\n "num_gpu": 99\n}missing
979Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruetrue520231213_233605__93000.07.855290[90, 229]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231213_233605__930.json50.0missingmissingmissing
980Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruetrue520231224_234436__40700.07.828150[90, 229]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_234436__407.json50.0missing{\n "num_gpu": 99\n}missing
981Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruetrue520231224_234442__15300.05.748220[1, 183]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_234442__153.json50.0missing{\n "num_gpu": 99\n}missing
982Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruefalse520231226_215441__59600.09.611070[90, 286]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_215441__596.json25.0missing{\n "num_gpu": 99\n}missing
983Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruetrue520231213_233557__20200.016.53710[201, 438]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233557__202.json50.0missingmissingmissing
984Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruetrue520231224_234411__98400.021.98942[219, 446]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234411__984.json75.0missing{\n "num_gpu": 99\n}missing
985Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruetrue520231224_234428__37200.016.81160[1, 489]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234428__372.json50.0missing{\n "num_gpu": 99\n}missing
986Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruefalse520231226_215431__78300.015.26710[219, 270]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215431__783.json25.0missing{\n "num_gpu": 99\n}missing
987Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruefalse520231213_233715__96700.023.9610[11, 642]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233715__967.json25.0missingmissingmissing
988Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruefalse520231224_234629__22000.019.53440[11, 532]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234629__220.json25.0missing{\n "num_gpu": 99\n}missing
989Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruetrue520231224_234645__77800.015.95470[1, 445]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234645__778.json50.0missing{\n "num_gpu": 99\n}missing
990Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruetrue520231226_215527__13600.015.93010[11, 445]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215527__136.json50.0missing{\n "num_gpu": 99\n}missing
991Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruefalse520231213_233651__67900.019.8980[361, 462]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231213_233651__679.json25.0missingmissingmissing
992Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruefalse520231224_234555__38000.019.39890[361, 450]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_234555__380.json25.0missing{\n "num_gpu": 99\n}missing
993Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruefalse520231224_234610__41100.015.21640[1, 426]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_234610__411.json25.0missing{\n "num_gpu": 99\n}missing
994Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruetrue520231226_215511__17300.021.80572[361, 520]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_215511__173.json75.0missing{\n "num_gpu": 99\n}missing
995Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruefalse520231213_234528__33400.022.16870[60, 642]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231213_234528__334.json25.0missingmissingmissing
996Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruetrue520231225_000558__91000.08.120410[60, 267]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231225_000558__910.json50.0missing{\n "num_gpu": 99\n}missing
997Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruefalse520231225_000606__66900.08.190330[60, 270]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231225_000606__669.json25.0missing{\n "num_gpu": 99\n}missing
998Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruetrue520231226_220208__59500.05.944340[60, 194]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231226_220208__595.json50.0missing{\n "num_gpu": 99\n}missing
999Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTtruetrue520231213_234505__55100.06.463710[90, 186]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231213_234505__551.json50.0missingmissingmissing
1000Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTtruetrue520231225_000541__14110.06.130972[100, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_000541__141.json80.0missing{\n "num_gpu": 99\n}missing
1001Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTfalsefalse520231225_000550__44500.08.803940[100, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_000550__445.json0.0missing{\n "num_gpu": 99\n}missing
1002Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTtruetrue520231226_220202__92200.08.756880[100, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_220202__922.json50.0missing{\n "num_gpu": 99\n}missing
1003Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231213_234459__57500.015.21930[201, 403]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234459__575.json0.0missingmissingmissing
1004Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_000528__45100.012.9830[211, 204]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000528__451.json0.0missing{\n "num_gpu": 99\n}missing
1005Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTtruefalse520231225_000534__85000.06.623460[211, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000534__850.json25.0missing{\n "num_gpu": 99\n}missing
1006Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTtruefalse520231226_220153__36200.014.9320[211, 276]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220153__362.json25.0missing{\n "num_gpu": 99\n}missing
1007Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231213_234627__97200.024.85570[11, 665]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234627__972.json50.0missingmissingmissing
1008Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_000642__87900.010.30140[364, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000642__879.json50.0missing{\n "num_gpu": 99\n}missing
1009Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_000649__62500.06.710470[364, 167]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000649__625.json50.0missing{\n "num_gpu": 99\n}missing
1010Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_220223__53750.08.258332[364, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220223__537.json100.0missing{\n "num_gpu": 99\n}missing
1011Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTfalsefalse520231213_234602__93700.020.91370[361, 489]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231213_234602__937.json0.0missingmissingmissing
1012Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTtruefalse520231225_000622__25100.07.6730[361, 198]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_000622__251.json25.0missing{\n "num_gpu": 99\n}missing
1013Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTtruetrue520231225_000631__38500.08.947080[361, 240]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_000631__385.json50.0missing{\n "num_gpu": 99\n}missing
1014Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTtruetrue520231226_220215__78150.06.854072[361, 173]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_220215__781.json100.0missing{\n "num_gpu": 99\n}missing
1015Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175048__16500.08.99840[60, 174]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175048__165.json50.0missing{\n "num_gpu": 99\n}missing
1016Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175057__42950.08.39592[60, 162]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175057__429.json100.0missing{\n "num_gpu": 99\n}missing
1017Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175116__34800.019.37070[60, 380]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175116__348.json50.0missing{\n "num_gpu": 99\n}missing
1018Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175014__30000.09.921160[100, 186]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175014__300.json50.0missing{\n "num_gpu": 99\n}missing
1019Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175029__47000.014.77040[100, 282]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175029__470.json50.0missing{\n "num_gpu": 99\n}missing
1020Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175039__30200.010.42790[100, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175039__302.json50.0missing{\n "num_gpu": 99\n}missing
1021Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_174934__85700.022.08240[211, 393]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174934__857.json50.0missing{\n "num_gpu": 99\n}missing
1022Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_174946__63700.012.20470[211, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174946__637.json0.0missing{\n "num_gpu": 99\n}missing
1023Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_175004__81300.017.58410[211, 324]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175004__813.json25.0missing{\n "num_gpu": 99\n}missing
1024Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175215__66700.016.50310[364, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175215__667.json50.0missing{\n "num_gpu": 99\n}missing
1025Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175230__93500.015.2010[364, 258]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175230__935.json50.0missing{\n "num_gpu": 99\n}missing
1026Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_175245__18300.014.48490[364, 244]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175245__183.json25.0missing{\n "num_gpu": 99\n}missing
1027Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_175132__70600.015.2040[361, 258]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175132__706.json25.0missing{\n "num_gpu": 99\n}missing
1028Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175143__13010.011.26412[361, 182]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175143__130.json80.0missing{\n "num_gpu": 99\n}missing
1029Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175158__94100.015.00390[361, 254]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175158__941.json50.0missing{\n "num_gpu": 99\n}missing
1030Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_215710__58700.011.72710[1, 368]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_215710__587.json25.0missingmissingmissing
1031Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_215724__73400.013.44370[1, 418]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_215724__734.json25.0missingmissingmissing
1032Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_003514__20500.013.51210[56, 343]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_003514__205.json25.0missing{\n "num_gpu": 99\n}missing
1033Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_003519__29600.05.212060[56, 128]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_003519__296.json50.0missing{\n "num_gpu": 99\n}missing
1034Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231226_221455__48800.05.93370[56, 147]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_221455__488.json25.0missing{\n "num_gpu": 99\n}missing
1035Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_215620__88200.06.51070[1, 207]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215620__882.json25.0missingmissingmissing
1036Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_215638__18800.018.42530[1, 553]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215638__188.json25.0missingmissingmissing
1037Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_003458__68100.03.474130[98, 74]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003458__681.json0.0missing{\n "num_gpu": 99\n}missing
1038Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_003501__64600.02.230430[98, 41]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003501__646.json0.0missing{\n "num_gpu": 99\n}missing
1039Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_221449__50100.02.803550[98, 56]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221449__501.json0.0missing{\n "num_gpu": 99\n}missing
1040Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_215550__73400.08.983510[1, 272]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215550__734.json25.0missingmissingmissing
1041Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_215603__21000.012.89470[1, 383]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215603__210.json25.0missingmissingmissing
1042Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_003442__92900.015.8390[209, 230]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003442__929.json25.0missing{\n "num_gpu": 99\n}missing
1043Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_003455__23200.013.17290[209, 309]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003455__232.json0.0missing{\n "num_gpu": 99\n}missing
1044Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_221446__63600.010.75120[209, 110]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221446__636.json25.0missing{\n "num_gpu": 99\n}missing
1045Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215931__41700.019.0540[1, 526]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215931__417.json25.0missingmissingmissing
1046Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215942__85600.011.17120[1, 319]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215942__856.json25.0missingmissingmissing
1047Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_003600__98100.011.51320[365, 242]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003600__981.json0.0missing{\n "num_gpu": 99\n}missing
1048Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003610__91610.09.92141[365, 202]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003610__916.json67.5missing{\n "num_gpu": 99\n}missing
1049Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_221537__61900.020.16220[365, 455]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221537__619.json50.0missing{\n "num_gpu": 99\n}missing
1050Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215838__36900.015.3460[1, 431]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215838__369.json25.0missingmissingmissing
1051Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215855__49200.017.31690[1, 482]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215855__492.json25.0missingmissingmissing
1052Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003537__79110.09.645231[363, 195]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003537__791.json67.5missing{\n "num_gpu": 99\n}missing
1053Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_003549__32800.010.89390[363, 226]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003549__328.json25.0missing{\n "num_gpu": 99\n}missing
1054Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231226_221516__38000.021.48070[363, 487]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221516__380.json25.0missing{\n "num_gpu": 99\n}missing
1055Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224733__81600.010.43850[55, 335]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224733__816.json50.0missing{\n "num_gpu": 99\n}missing
1056Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_224746__85500.012.22690[55, 392]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224746__855.json0.0missing{\n "num_gpu": 99\n}missing
1057Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224759__93100.013.61060[55, 436]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224759__931.json50.0missing{\n "num_gpu": 99\n}missing
1058Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224816__76200.016.72340[55, 535]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224816__762.json50.0missing{\n "num_gpu": 99\n}missing
1059Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224823__81900.06.505450[55, 206]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224823__819.json50.0missing{\n "num_gpu": 99\n}missing
1060Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224709__31700.02.335560[97, 58]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224709__317.json50.0missing{\n "num_gpu": 99\n}missing
1061Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224712__22210.02.206181[97, 54]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224712__222.json67.5missing{\n "num_gpu": 99\n}missing
1062Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_224714__15700.02.297440[97, 56]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224714__157.json0.0missing{\n "num_gpu": 99\n}missing
1063Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224720__72500.05.949030[97, 177]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224720__725.json50.0missing{\n "num_gpu": 99\n}missing
1064Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224723__34800.02.217170[97, 54]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224723__348.json50.0missing{\n "num_gpu": 99\n}missing
1065Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224621__19800.014.98472[208, 416]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224621__198.json75.0missing{\n "num_gpu": 99\n}missing
1066Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224634__96600.013.1070[208, 390]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224634__966.json50.0missing{\n "num_gpu": 99\n}missing
1067Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224649__82600.015.0972[208, 452]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224649__826.json75.0missing{\n "num_gpu": 99\n}missing
1068Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224659__53100.09.975390[208, 291]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224659__531.json50.0missing{\n "num_gpu": 99\n}missing
1069Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_224707__29100.07.689190[208, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224707__291.json25.0missing{\n "num_gpu": 99\n}missing
1070Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_224955__26500.014.4580[364, 401]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224955__265.json25.0missing{\n "num_gpu": 99\n}missing
1071Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_225012__67100.016.33430[364, 458]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225012__671.json50.0missing{\n "num_gpu": 99\n}missing
1072Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_225024__36000.012.29920[364, 334]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225024__360.json0.0missing{\n "num_gpu": 99\n}missing
1073Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_225041__11700.016.68222[364, 469]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225041__117.json75.0missing{\n "num_gpu": 99\n}missing
1074Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_225056__55500.015.54440[364, 434]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225056__555.json25.0missing{\n "num_gpu": 99\n}missing
1075Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224839__20210.015.94372[362, 447]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224839__202.json80.0missing{\n "num_gpu": 99\n}missing
1076Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224858__74300.018.47950[362, 522]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224858__743.json50.0missing{\n "num_gpu": 99\n}missing
1077Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224910__68800.011.88070[362, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224910__688.json50.0missing{\n "num_gpu": 99\n}missing
1078Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224924__45200.014.12741[362, 391]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224924__452.json62.5missing{\n "num_gpu": 99\n}missing
1079Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224941__48600.015.76830[362, 441]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224941__486.json50.0missing{\n "num_gpu": 99\n}missing
1080Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225244__80800.010.87580[55, 274]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225244__808.json50.0missing{\n "num_gpu": 99\n}missing
1081Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_225303__72900.019.36720[55, 490]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225303__729.json25.0missing{\n "num_gpu": 99\n}missing
1082Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225319__40510.015.68361[55, 397]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225319__405.json67.5missing{\n "num_gpu": 99\n}missing
1083Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225337__69310.017.49941[55, 443]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225337__693.json67.5missing{\n "num_gpu": 99\n}missing
1084Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225355__67800.018.35850[55, 465]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225355__678.json50.0missing{\n "num_gpu": 99\n}missing
1085Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225215__82400.06.021550[97, 140]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225215__824.json50.0missing{\n "num_gpu": 99\n}missing
1086Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225221__30400.05.922140[97, 137]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225221__304.json50.0missing{\n "num_gpu": 99\n}missing
1087Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225226__47300.04.163560[97, 91]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225226__473.json50.0missing{\n "num_gpu": 99\n}missing
1088Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225229__85400.03.308120[97, 69]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225229__854.json50.0missing{\n "num_gpu": 99\n}missing
1089Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225233__25200.03.458890[97, 73]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225233__252.json50.0missing{\n "num_gpu": 99\n}missing
1090Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_225110__62810.013.10331[208, 285]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225110__628.json67.5missing{\n "num_gpu": 99\n}missing
1091Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_225123__77900.013.59672[208, 318]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225123__779.json75.0missing{\n "num_gpu": 99\n}missing
1092Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_225135__78200.011.76920[208, 272]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225135__782.json25.0missing{\n "num_gpu": 99\n}missing
1093Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_225153__94000.018.39070[208, 438]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225153__940.json50.0missing{\n "num_gpu": 99\n}missing
1094Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_225209__97200.015.61150[208, 369]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225209__972.json0.0missing{\n "num_gpu": 99\n}missing
1095Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_225546__40200.010.54310[364, 216]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225546__402.json50.0missing{\n "num_gpu": 99\n}missing
1096Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_225608__90710.021.28661[364, 480]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225608__907.json67.5missing{\n "num_gpu": 99\n}missing
1097Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_225625__90400.016.96810[364, 375]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225625__904.json25.0missing{\n "num_gpu": 99\n}missing
1098Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_225636__97000.011.85150[364, 249]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225636__970.json50.0missing{\n "num_gpu": 99\n}missing
1099Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_225658__67300.020.8260[364, 469]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225658__673.json25.0missing{\n "num_gpu": 99\n}missing
1100Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225415__37500.019.5050[362, 437]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225415__375.json50.0missing{\n "num_gpu": 99\n}missing
1101Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225428__88400.013.17640[362, 282]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225428__884.json50.0missing{\n "num_gpu": 99\n}missing
1102Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_225445__23400.016.27740[362, 358]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225445__234.json25.0missing{\n "num_gpu": 99\n}missing
1103Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225509__98600.024.42870[362, 556]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225509__986.json50.0missing{\n "num_gpu": 99\n}missing
1104Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225536__59500.026.0550[362, 595]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225536__595.json50.0missing{\n "num_gpu": 99\n}missing
1105Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120244__33000.015.44740[55, 284]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120244__330.json50.0missing{\n "num_gpu": 99\n}missing
1106Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120301__20500.016.5910[55, 305]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120301__205.json50.0missing{\n "num_gpu": 99\n}missing
1107Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_221745__73400.013.17330[55, 243]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_221745__734.json0.0missing{\n "num_gpu": 99\n}missing
1108Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_120223__30000.010.31570[97, 181]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120223__300.json0.0missing{\n "num_gpu": 99\n}missing
1109Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_120228__75700.05.801720[97, 96]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120228__757.json50.0missing{\n "num_gpu": 99\n}missing
1110Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_221732__25900.04.857360[97, 79]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_221732__259.json50.0missing{\n "num_gpu": 99\n}missing
1111Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120152__58000.020.92270[208, 365]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120152__580.json50.0missing{\n "num_gpu": 99\n}missing
1112Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120212__47800.019.98632[208, 348]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120212__478.json75.0missing{\n "num_gpu": 99\n}missing
1113Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_221727__44610.025.80751[208, 293]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221727__446.json67.5missing{\n "num_gpu": 99\n}missing
1114Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120435__89300.022.47040[364, 372]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120435__893.json50.0missing{\n "num_gpu": 99\n}missing
1115Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120503__23910.028.10811[364, 473]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120503__239.json67.5missing{\n "num_gpu": 99\n}missing
1116Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_221851__10700.028.11580[364, 477]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221851__107.json50.0missing{\n "num_gpu": 99\n}missing
1117Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120351__68800.022.5180[362, 373]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120351__688.json50.0missing{\n "num_gpu": 99\n}missing
1118Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120412__20610.021.55631[362, 356]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120412__206.json67.5missing{\n "num_gpu": 99\n}missing
1119Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_221823__91710.038.09781[362, 655]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_221823__917.json67.5missing{\n "num_gpu": 99\n}missing
1120Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_103555__56510.041.59981[61, 241]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_103555__565.json67.5missing{\n "num_gpu": 99\n}missing
1121Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_103621__85100.025.91090[61, 145]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_103621__851.json50.0missing{\n "num_gpu": 99\n}missing
1122Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_103712__36100.049.99460[61, 276]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_103712__361.json50.0missing{\n "num_gpu": 99\n}missing
1123Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142911__27700.031.66570[61, 186]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142911__277.json50.0missing{\n "num_gpu": 99\n}missing
1124Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142956__18500.044.4840[61, 264]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142956__185.json50.0missing{\n "num_gpu": 99\n}missing
1125Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_103449__12700.013.57080[100, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_103449__127.json0.0missing{\n "num_gpu": 99\n}missing
1126Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_103500__68000.011.31950[100, 51]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_103500__680.json50.0missing{\n "num_gpu": 99\n}missing
1127Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_103513__76750.013.04912[100, 62]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_103513__767.json100.0missing{\n "num_gpu": 99\n}missing
1128Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_142756__75600.08.55010[100, 34]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_142756__756.json0.0missing{\n "num_gpu": 99\n}missing
1129Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_142839__22100.043.26311[100, 247]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_142839__221.json62.5missing{\n "num_gpu": 99\n}missing
1130Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_103220__80600.067.22720[211, 338]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_103220__806.json25.0missing{\n "num_gpu": 99\n}missing
1131Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_103340__17500.080.44410[211, 443]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_103340__175.json50.0missing{\n "num_gpu": 99\n}missing
1132Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_103435__71910.054.7441[211, 299]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_103435__719.json67.5missing{\n "num_gpu": 99\n}missing
1133Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_142731__38400.059.9870[211, 330]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_142731__384.json25.0missing{\n "num_gpu": 99\n}missing
1134Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_142747__96900.016.00410[211, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_142747__969.json0.0missing{\n "num_gpu": 99\n}missing
1135Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_104055__29100.046.48480[374, 222]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104055__291.json50.0missing{\n "num_gpu": 99\n}missing
1136Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_104201__59710.065.17421[374, 332]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104201__597.json67.5missing{\n "num_gpu": 99\n}missing
1137Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_104309__91500.068.08331[374, 349]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104309__915.json62.5missing{\n "num_gpu": 99\n}missing
1138Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_143301__23650.042.29012[374, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_143301__236.json100.0missing{\n "num_gpu": 99\n}missing
1139Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_143345__59710.043.63461[374, 204]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_143345__597.json67.5missing{\n "num_gpu": 99\n}missing
1140Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_103804__53100.050.99490[372, 237]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_103804__531.json50.0missing{\n "num_gpu": 99\n}missing
1141Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_103944__95500.099.63070[372, 525]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_103944__955.json50.0missing{\n "num_gpu": 99\n}missing
1142Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_104009__83900.024.77350[372, 92]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_104009__839.json0.0missing{\n "num_gpu": 99\n}missing
1143Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_143049__14500.052.98370[372, 259]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_143049__145.json0.0missing{\n "num_gpu": 99\n}missing
1144Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_143219__47700.089.8370[372, 474]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_143219__477.json50.0missing{\n "num_gpu": 99\n}missing
1145Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_220119__79800.015.29350[1, 471]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_220119__798.json0.0missingmissingmissing
1146Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_220134__44300.015.57540[1, 479]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_220134__443.json25.0missingmissingmissing
1147Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_003701__36610.08.351181[64, 210]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_003701__366.json67.5missing{\n "num_gpu": 99\n}missing
1148Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_003707__11800.06.605280[64, 164]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_003707__118.json50.0missing{\n "num_gpu": 99\n}missing
1149Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231226_221601__57300.06.491090[64, 161]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_221601__573.json25.0missing{\n "num_gpu": 99\n}missing
1150Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_220051__41200.03.213470[1, 104]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_220051__412.json25.0missingmissingmissing
1151Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_220052__95500.01.537990[1, 50]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_220052__955.json0.0missingmissingmissing
1152Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_003647__34300.02.843940[106, 57]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003647__343.json50.0missing{\n "num_gpu": 99\n}missing
1153Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_003652__57400.04.680830[106, 105]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003652__574.json50.0missing{\n "num_gpu": 99\n}missing
1154Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_221555__51700.03.562130[106, 76]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221555__517.json50.0missing{\n "num_gpu": 99\n}missing
1155Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_220016__59900.016.90620[1, 493]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220016__599.json25.0missingmissingmissing
1156Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_220032__67400.015.94530[1, 467]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220032__674.json0.0missingmissingmissing
1157Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003631__88900.020.87870[217, 342]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003631__889.json50.0missing{\n "num_gpu": 99\n}missing
1158Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003644__38900.013.25270[217, 310]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003644__389.json50.0missing{\n "num_gpu": 99\n}missing
1159Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_221551__43100.014.50610[217, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221551__431.json25.0missing{\n "num_gpu": 99\n}missing
1160Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_220354__44500.023.62060[1, 641]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220354__445.json25.0missingmissingmissing
1161Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_220356__92000.01.892880[1, 56]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220356__920.json0.0missingmissingmissing
1162Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003750__20400.010.74890[373, 222]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003750__204.json50.0missing{\n "num_gpu": 99\n}missing
1163Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003802__71710.011.41221[373, 239]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003802__717.json67.5missing{\n "num_gpu": 99\n}missing
1164Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_221623__54000.011.94980[373, 252]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221623__540.json50.0missing{\n "num_gpu": 99\n}missing
1165Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_220300__26400.019.84960[1, 547]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_220300__264.json25.0missingmissingmissing
1166Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_220318__58900.017.69380[1, 492]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_220318__589.json25.0missingmissingmissing
1167Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003730__17600.07.200250[371, 133]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003730__176.json50.0missing{\n "num_gpu": 99\n}missing
1168Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003740__57900.09.222240[371, 184]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003740__579.json50.0missing{\n "num_gpu": 99\n}missing
1169Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_221611__74500.09.225550[371, 184]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221611__745.json50.0missing{\n "num_gpu": 99\n}missing
1170Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruefalse520231213_233751__85000.013.84920[60, 416]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_233751__850.json25.0missingmissingmissing
1171Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruetrue520231224_234738__46110.05.869082[62, 188]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_234738__461.json80.0missing{\n "num_gpu": 99\n}missing
1172Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruetrue520231224_234750__67200.011.04880[62, 359]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_234750__672.json50.0missing{\n "num_gpu": 99\n}missing
1173Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruetrue520231226_215558__28300.09.136740[62, 293]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_215558__283.json50.0missing{\n "num_gpu": 99\n}missing
1174Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231213_233737__85400.05.212130[90, 148]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_233737__854.json50.0missingmissingmissing
1175Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231224_234726__34900.08.273240[104, 257]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_234726__349.json0.0missing{\n "num_gpu": 99\n}missing
1176Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231224_234732__53700.06.500690[104, 199]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_234732__537.json50.0missing{\n "num_gpu": 99\n}missing
1177Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_215549__58500.03.753570[104, 107]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_215549__585.json50.0missing{\n "num_gpu": 99\n}missing
1178Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231213_233731__33400.016.03440[201, 425]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233731__334.json50.0missingmissingmissing
1179Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231224_234701__99300.015.83520[215, 310]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234701__993.json25.0missing{\n "num_gpu": 99\n}missing
1180Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231224_234717__72910.015.78531[215, 480]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234717__729.json67.5missing{\n "num_gpu": 99\n}missing
1181Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_215545__76600.018.63942[215, 403]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215545__766.json75.0missing{\n "num_gpu": 99\n}missing
1182Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231213_233838__79900.016.46170[11, 452]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233838__799.json0.0missingmissingmissing
1183Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_234827__59300.08.453540[371, 219]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234827__593.json50.0missing{\n "num_gpu": 99\n}missing
1184Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_234841__32210.013.87552[371, 389]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234841__322.json80.0missing{\n "num_gpu": 99\n}missing
1185Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231226_215626__27500.06.394910[371, 153]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215626__275.json50.0missing{\n "num_gpu": 99\n}missing
1186Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231213_233821__46600.016.90210[361, 383]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_233821__466.json50.0missingmissingmissing
1187Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231224_234809__99610.010.59461[369, 286]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_234809__996.json67.5missing{\n "num_gpu": 99\n}missing
1188Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231224_234818__90200.09.209940[369, 243]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_234818__902.json50.0missing{\n "num_gpu": 99\n}missing
1189Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231226_215620__45400.021.18480[369, 610]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_215620__454.json25.0missing{\n "num_gpu": 99\n}missing
1190Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTtruefalse520231213_234827__61300.013.15330[60, 398]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231213_234827__613.json25.0missingmissingmissing
1191Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTfalsefalse520231225_001000__77400.018.82940[63, 346]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231225_001000__774.json0.0missing{\n "num_gpu": 99\n}missing
1192Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTfalsefalse520231225_001003__32800.02.847860[63, 44]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231225_001003__328.json0.0missing{\n "num_gpu": 99\n}missing
1193Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTfalsefalse520231226_220408__60500.024.48420[63, 451]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231226_220408__605.json0.0missing{\n "num_gpu": 99\n}missing
1194Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTtruetrue520231213_234814__41800.05.967850[90, 172]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231213_234814__418.json50.0missingmissingmissing
1195Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_000929__44200.010.24840[103, 176]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_000929__442.json0.0missing{\n "num_gpu": 99\n}missing
1196Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_000941__64000.012.20040[103, 212]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_000941__640.json0.0missing{\n "num_gpu": 99\n}missing
1197Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_220344__81200.09.617630[103, 164]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_220344__812.json0.0missing{\n "num_gpu": 99\n}missing
1198Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231213_234808__33700.013.81620[201, 365]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234808__337.json50.0missingmissingmissing
1199Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231225_000853__19600.034.8770[214, 429]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000853__196.json25.0missing{\n "num_gpu": 99\n}missing
1200Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_000918__21800.025.49350[214, 435]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000918__218.json0.0missing{\n "num_gpu": 99\n}missing
1201Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231226_220334__98800.037.66270[214, 494]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220334__988.json25.0missing{\n "num_gpu": 99\n}missing
1202Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231213_234916__42700.014.6780[11, 406]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234916__427.json50.0missingmissingmissing
1203Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_001152__92200.027.75760[367, 442]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_001152__922.json0.0missing{\n "num_gpu": 99\n}missing
1204Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_001222__95110.030.19041[367, 484]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_001222__951.json67.5missing{\n "num_gpu": 99\n}missing
1205Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231226_220510__48600.042.63680[367, 696]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220510__486.json25.0missing{\n "num_gpu": 99\n}missing
1206Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTfalsefalse520231213_234901__64600.020.10890[361, 469]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231213_234901__646.json0.0missingmissingmissing
1207Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTtruetrue520231225_001102__59400.014.13290[364, 202]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_001102__594.json50.0missing{\n "num_gpu": 99\n}missing
1208Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_001124__45200.021.90110[364, 340]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_001124__452.json0.0missing{\n "num_gpu": 99\n}missing
1209Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_220427__66600.019.43660[364, 298]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_220427__666.json0.0missing{\n "num_gpu": 99\n}missing
1210Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_220545__20100.018.84850[1, 571]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_220545__201.json25.0missingmissingmissing
1211Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_220603__79800.017.77430[1, 541]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_220603__798.json0.0missingmissingmissing
1212Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_003845__63500.00.8485940[54, 28]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_003845__635.json0.0missing{\n "num_gpu": 99\n}missing
1213Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_003904__70200.019.01770[54, 722]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_003904__702.json0.0missing{\n "num_gpu": 99\n}missing
1214Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231226_221654__79600.01.364340[54, 49]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_221654__796.json0.0missing{\n "num_gpu": 99\n}missing
1215Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_220501__36800.013.39850[1, 412]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_220501__368.json25.0missingmissingmissing
1216Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_220512__56200.011.27810[1, 350]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_220512__562.json25.0missingmissingmissing
1217Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_003843__88300.01.808960[91, 63]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_003843__883.json0.0missing{\n "num_gpu": 99\n}missing
1218Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_003844__29000.01.160570[91, 36]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_003844__290.json0.0missing{\n "num_gpu": 99\n}missing
1219Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_221653__79800.025.22280[91, 925]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_221653__798.json0.0missing{\n "num_gpu": 99\n}missing
1220Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_220427__28400.013.99890[1, 414]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220427__284.json25.0missingmissingmissing
1221Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_220438__32800.010.36010[1, 311]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220438__328.json25.0missingmissingmissing
1222Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_003826__75800.023.91410[199, 728]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003826__758.json0.0missing{\n "num_gpu": 99\n}missing
1223Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_003841__40100.015.15610[199, 550]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003841__401.json0.0missing{\n "num_gpu": 99\n}missing
1224Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_221627__98600.04.646060[199, 22]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221627__986.json0.0missing{\n "num_gpu": 99\n}missing
1225Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_220813__34100.021.47440[1, 587]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220813__341.json25.0missingmissingmissing
1226Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_220830__59800.016.98470[1, 473]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220830__598.json25.0missingmissingmissing
1227Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_004013__52000.016.51710[343, 565]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004013__520.json0.0missing{\n "num_gpu": 99\n}missing
1228Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_004051__68500.037.49030[343, 1243]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004051__685.json0.0missing{\n "num_gpu": 99\n}missing
1229Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_221701__30400.01.773310[343, 26]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221701__304.json0.0missing{\n "num_gpu": 99\n}missing
1230Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_220716__11800.017.0380[1, 475]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_220716__118.json25.0missingmissingmissing
1231Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_220734__79100.017.31870[1, 482]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_220734__791.json25.0missingmissingmissing
1232Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_003939__57000.04.588150[340, 134]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_003939__570.json0.0missing{\n "num_gpu": 99\n}missing
1233Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_003957__54300.017.33810[340, 594]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_003957__543.json0.0missing{\n "num_gpu": 99\n}missing
1234Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_221659__76000.05.006950[340, 150]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_221659__760.json0.0missing{\n "num_gpu": 99\n}missing
1235Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTtruetrue520231213_234951__78000.014.19140[60, 428]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231213_234951__780.json50.0missingmissingmissing
1236Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTfalsefalse520231225_001522__11400.037.27750[71, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_001522__114.json0.0missing{\n "num_gpu": 99\n}missing
1237Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_001556__11250.033.662[71, 258]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_001556__112.json100.0missing{\n "num_gpu": 99\n}missing
1238Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTfalsefalse520231226_220726__98300.039.43450[71, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_220726__983.json0.0missing{\n "num_gpu": 99\n}missing
1239Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231213_234937__77900.06.456240[90, 187]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231213_234937__779.json50.0missingmissingmissing
1240Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_001414__53950.020.34672[111, 145]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_001414__539.json100.0missing{\n "num_gpu": 99\n}missing
1241Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_001445__48110.031.24452[111, 233]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_001445__481.json80.0missing{\n "num_gpu": 99\n}missing
1242Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_220647__75200.029.38220[111, 217]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_220647__752.json50.0missing{\n "num_gpu": 99\n}missing
1243Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231213_234930__40400.013.92180[201, 368]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234930__404.json50.0missingmissingmissing
1244Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231225_001300__29200.038.20290[222, 89]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_001300__292.json25.0missing{\n "num_gpu": 99\n}missing
1245Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231225_001353__89100.053.08550[222, 387]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_001353__891.json0.0missing{\n "num_gpu": 99\n}missing
1246Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231226_220617__83900.067.04740[222, 331]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220617__839.json25.0missing{\n "num_gpu": 99\n}missing
1247Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231213_235043__44100.018.33640[11, 502]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235043__441.json25.0missingmissingmissing
1248Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_001920__25400.029.76470[375, 175]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_001920__254.json50.0missing{\n "num_gpu": 99\n}missing
1249Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_002021__81650.060.90932[375, 416]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_002021__816.json100.0missing{\n "num_gpu": 99\n}missing
1250Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231226_220920__19700.046.05860[375, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220920__197.json25.0missing{\n "num_gpu": 99\n}missing
1251Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231213_235025__75800.019.48971[361, 453]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231213_235025__758.json62.5missingmissingmissing
1252Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231225_001758__85100.048.08350[372, 318]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_001758__851.json25.0missing{\n "num_gpu": 99\n}missing
1253Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_001850__65310.052.37592[372, 351]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_001850__653.json80.0missing{\n "num_gpu": 99\n}missing
1254Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_220834__60950.067.68112[372, 468]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_220834__609.json100.0missing{\n "num_gpu": 99\n}missing
1255Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_215250__84200.013.61830[1, 423]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_215250__842.json25.0missingmissingmissing
1256Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_215304__79100.014.37470[1, 445]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_215304__791.json0.0missingmissingmissing
1257Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231225_003223__89100.014.50140[64, 247]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_003223__891.json0.0missing{\n "num_gpu": 99\n}missing
1258Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_003241__83000.017.48550[64, 299]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_003241__830.json50.0missing{\n "num_gpu": 99\n}missing
1259Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231226_221404__41110.018.77041[64, 321]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_221404__411.json67.5missing{\n "num_gpu": 99\n}missing
1260Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_215214__72500.06.506020[1, 207]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215214__725.json25.0missingmissingmissing
1261Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_215224__78100.09.680380[1, 303]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215224__781.json25.0missingmissingmissing
1262Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_003155__19100.010.28210[106, 164]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003155__191.json50.0missing{\n "num_gpu": 99\n}missing
1263Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_003209__80900.013.47680[106, 220]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003209__809.json0.0missing{\n "num_gpu": 99\n}missing
1264Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_221346__67000.017.33570[106, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221346__670.json50.0missing{\n "num_gpu": 99\n}missing
1265Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_215149__67000.017.23880[1, 502]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215149__670.json25.0missingmissingmissing
1266Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_215200__64900.011.24590[1, 337]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215200__649.json0.0missingmissingmissing
1267Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003125__39600.032.54780[217, 372]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003125__396.json50.0missing{\n "num_gpu": 99\n}missing
1268Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003145__59300.019.6560[217, 310]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003145__593.json50.0missing{\n "num_gpu": 99\n}missing
1269Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_221328__22900.026.47030[217, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221328__229.json0.0missing{\n "num_gpu": 99\n}missing
1270Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215510__19200.017.11190[1, 476]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215510__192.json25.0missingmissingmissing
1271Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215531__42300.021.02860[1, 576]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215531__423.json25.0missingmissingmissing
1272Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_003410__81600.022.01890[373, 324]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003410__816.json0.0missing{\n "num_gpu": 99\n}missing
1273Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_003426__30900.015.88340[373, 221]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003426__309.json0.0missing{\n "num_gpu": 99\n}missing
1274Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231226_221435__79000.015.91670[373, 222]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221435__790.json0.0missing{\n "num_gpu": 99\n}missing
1275Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215415__76800.014.95310[1, 420]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215415__768.json25.0missingmissingmissing
1276Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215433__63100.017.54860[1, 488]0.5.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215433__631.json25.0missingmissingmissing
1277Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003331__89000.018.06920[371, 258]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003331__890.json50.0missing{\n "num_gpu": 99\n}missing
1278Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003348__52300.017.05370[371, 241]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003348__523.json50.0missing{\n "num_gpu": 99\n}missing
1279Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_221419__64700.014.91660[371, 205]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221419__647.json50.0missing{\n "num_gpu": 99\n}missing
1280Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTtruefalse520231213_234706__78100.017.94750[60, 535]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231213_234706__781.json25.0missingmissingmissing
1281Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTtruefalse520231225_000727__54200.05.680330[66, 323]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_000727__542.json25.0missing{\n "num_gpu": 99\n}missing
1282Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTtruetrue520231225_000733__38600.06.239730[66, 355]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_000733__386.json50.0missing{\n "num_gpu": 99\n}missing
1283Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTtruetrue520231226_220239__33100.04.962010[66, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_220239__331.json50.0missing{\n "num_gpu": 99\n}missing
1284Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231213_234648__51000.06.581831[90, 190]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231213_234648__510.json62.5missingmissingmissing
1285Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_000713__17100.03.224530[103, 176]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_000713__171.json0.0missing{\n "num_gpu": 99\n}missing
1286Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_000721__93100.08.220050[103, 454]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_000721__931.json0.0missing{\n "num_gpu": 99\n}missing
1287Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231226_220234__31700.02.720040[103, 146]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_220234__317.json25.0missing{\n "num_gpu": 99\n}missing
1288Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231213_234642__41900.014.36450[201, 380]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234642__419.json50.0missingmissingmissing
1289Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231225_000701__90400.012.66510[208, 509]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000701__904.json25.0missing{\n "num_gpu": 99\n}missing
1290Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231225_000710__87700.08.113930[208, 421]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000710__877.json25.0missing{\n "num_gpu": 99\n}missing
1291Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_220232__56400.08.611710[208, 308]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220232__564.json0.0missing{\n "num_gpu": 99\n}missing
1292Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231213_234754__88000.017.51330[11, 481]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234754__880.json25.0missingmissingmissing
1293Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_000807__90100.013.69640[353, 651]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000807__901.json0.0missing{\n "num_gpu": 99\n}missing
1294Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_000818__19600.011.17660[353, 530]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000818__196.json25.0missing{\n "num_gpu": 99\n}missing
1295Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231226_220256__48800.07.170560[353, 330]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220256__488.json0.0missing{\n "num_gpu": 99\n}missing
1296Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231213_234736__91900.019.02380[361, 441]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231213_234736__919.json50.0missingmissingmissing
1297Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_000745__52400.06.110280[351, 279]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_000745__524.json50.0missing{\n "num_gpu": 99\n}missing
1298Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_000753__14300.07.9290[351, 373]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_000753__143.json25.0missing{\n "num_gpu": 99\n}missing
1299Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_220249__45500.09.122190[351, 432]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_220249__455.json50.0missing{\n "num_gpu": 99\n}missing
1300Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTfalsefalse520231213_233916__21900.09.821090[60, 297]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_233916__219.json0.0missingmissingmissing
1301Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTtruetrue520231224_234934__59410.07.268651[64, 234]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_234934__594.json67.5missing{\n "num_gpu": 99\n}missing
1302Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTtruetrue520231224_234943__16110.08.849931[64, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_234943__161.json67.5missing{\n "num_gpu": 99\n}missing
1303Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTtruetrue520231226_215713__31210.014.65761[64, 476]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_215713__312.json67.5missing{\n "num_gpu": 99\n}missing
1304Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231213_233907__14100.08.931960[90, 261]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_233907__141.json50.0missingmissingmissing
1305Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_234923__56200.05.871220[106, 178]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_234923__562.json50.0missing{\n "num_gpu": 99\n}missing
1306Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_234927__17400.04.150570[106, 120]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_234927__174.json50.0missing{\n "num_gpu": 99\n}missing
1307Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_215658__74610.012.11752[106, 383]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_215658__746.json80.0missing{\n "num_gpu": 99\n}missing
1308Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231213_233858__37500.019.6720[201, 523]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233858__375.json25.0missingmissingmissing
1309Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231224_234901__19210.020.47371[217, 450]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234901__192.json67.5missing{\n "num_gpu": 99\n}missing
1310Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231224_234917__61400.015.28630[217, 463]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234917__614.json0.0missing{\n "num_gpu": 99\n}missing
1311Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231226_215646__17500.019.5770[217, 438]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215646__175.json0.0missing{\n "num_gpu": 99\n}missing
1312Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231213_234001__33810.012.05081[11, 316]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234001__338.json67.5missingmissingmissing
1313Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231224_235037__55000.07.941650[373, 201]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_235037__550.json0.0missing{\n "num_gpu": 99\n}missing
1314Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231224_235105__16600.027.86190[373, 806]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_235105__166.json0.0missing{\n "num_gpu": 99\n}missing
1315Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_215729__67700.08.530790[373, 221]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215729__677.json50.0missing{\n "num_gpu": 99\n}missing
1316Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231213_233948__18000.021.12160[361, 491]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_233948__180.json50.0missingmissingmissing
1317Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_235015__43000.020.98470[371, 604]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_235015__430.json50.0missing{\n "num_gpu": 99\n}missing
1318Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_235029__84200.013.31960[371, 371]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_235029__842.json50.0missing{\n "num_gpu": 99\n}missing
1319Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_215721__94210.07.733761[371, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_215721__942.json67.5missing{\n "num_gpu": 99\n}missing
1320Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruefalse520231213_234035__39500.015.55520[60, 467]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_234035__395.json25.0missingmissingmissing
1321Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruefalse520231224_235418__52100.045.77270[61, 348]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_235418__521.json25.0missing{\n "num_gpu": 99\n}missing
1322Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruetrue520231224_235533__13510.075.17382[61, 570]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_235533__135.json80.0missing{\n "num_gpu": 99\n}missing
1323Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruefalse520231226_215927__91700.044.84180[61, 342]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_215927__917.json25.0missing{\n "num_gpu": 99\n}missing
1324Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231213_234019__56900.02.38510[90, 57]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_234019__569.json0.0missingmissingmissing
1325Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231224_235303__94700.020.10160[100, 138]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_235303__947.json50.0missing{\n "num_gpu": 99\n}missing
1326Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231224_235332__97900.028.91810[100, 207]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_235332__979.json50.0missing{\n "num_gpu": 99\n}missing
1327Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_215842__31700.031.33830[100, 226]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_215842__317.json50.0missing{\n "num_gpu": 99\n}missing
1328Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231213_234017__22400.016.00190[201, 424]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234017__224.json50.0missingmissingmissing
1329Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231224_235155__92100.050.60810[211, 167]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_235155__921.json25.0missing{\n "num_gpu": 99\n}missing
1330Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231224_235243__24910.047.14632[211, 328]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_235243__249.json80.0missing{\n "num_gpu": 99\n}missing
1331Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231226_215811__59000.041.26270[211, 109]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215811__590.json25.0missing{\n "num_gpu": 99\n}missing
1332Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231213_234126__38200.021.25960[11, 574]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234126__382.json50.0missingmissingmissing
1333Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_000004__41200.073.36340[374, 488]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000004__412.json25.0missing{\n "num_gpu": 99\n}missing
1334Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_000043__37000.039.11170[374, 237]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000043__370.json25.0missing{\n "num_gpu": 99\n}missing
1335Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231226_220035__33700.014.42880[374, 51]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220035__337.json0.0missing{\n "num_gpu": 99\n}missing
1336Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruetrue520231213_234105__32100.020.18890[361, 470]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_234105__321.json50.0missingmissingmissing
1337Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_235741__83700.036.54120[372, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_235741__837.json25.0missing{\n "num_gpu": 99\n}missing
1338Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_235850__98700.069.6420[372, 462]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_235850__987.json25.0missing{\n "num_gpu": 99\n}missing
1339Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_220021__78410.053.81361[372, 348]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_220021__784.json67.5missing{\n "num_gpu": 99\n}missing
1340Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruefalse520231214_000034__40100.024.54380[155, 675]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_000034__401.json25.0missingmissingmissing
1341Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruetrue520231225_010714__31300.023.45610[163, 408]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_010714__313.json50.0missing{\n "num_gpu": 99\n}missing
1342Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruetrue520231225_010733__63200.019.49320[163, 336]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_010733__632.json50.0missing{\n "num_gpu": 99\n}missing
1343Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruetrue520231226_223025__59440.027.17544[163, 477]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_223025__594.json90.0missing{\n "num_gpu": 99\n}missing
1344Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231214_000009__47900.015.50250[184, 420]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_000009__479.json0.0missingmissingmissing
1345Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_010632__63220.019.08823[201, 323]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_010632__632.json75.0missing{\n "num_gpu": 99\n}missing
1346Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_010650__12720.018.15043[201, 306]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_010650__127.json75.0missing{\n "num_gpu": 99\n}missing
1347Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_222958__80020.019.77784[201, 337]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_222958__800.json80.0missing{\n "num_gpu": 99\n}missing
1348Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231213_235953__95100.013.07690[280, 315]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235953__951.json25.0missingmissingmissing
1349Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_010554__10120.037.76643[298, 458]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_010554__101.json75.0missing{\n "num_gpu": 99\n}missing
1350Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_010613__60620.018.43113[298, 292]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_010613__606.json75.0missing{\n "num_gpu": 99\n}missing
1351Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_222938__20300.024.87980[298, 230]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222938__203.json0.0missing{\n "num_gpu": 99\n}missing
1352Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231214_000141__76000.025.90640[11, 673]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000141__760.json0.0missingmissingmissing
1353Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_010926__88510.025.67684[466, 388]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010926__885.json75.0missing{\n "num_gpu": 99\n}missing
1354Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_010955__45500.028.70180[466, 440]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010955__455.json50.0missing{\n "num_gpu": 99\n}missing
1355Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231226_223123__49500.031.01970[466, 481]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223123__495.json0.0missing{\n "num_gpu": 99\n}missing
1356Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_000115__90200.014.91840[455, 288]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_000115__902.json0.0missingmissingmissing
1357Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_010836__79600.015.29390[463, 207]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_010836__796.json50.0missing{\n "num_gpu": 99\n}missing
1358Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_010901__17720.024.62065[463, 370]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_010901__177.json85.0missing{\n "num_gpu": 99\n}missing
1359Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_223052__45120.026.44614[463, 403]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_223052__451.json80.0missing{\n "num_gpu": 99\n}missing
1360Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonInJulia1SHOTtruefalse520231214_000248__51700.025.25630[155, 693]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_000248__517.json25.0missingmissingmissing
1361Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_011051__68700.08.505580[137, 138]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_011051__687.json0.0missing{\n "num_gpu": 99\n}missing
1362Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_011119__71000.028.51890[137, 506]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_011119__710.json0.0missing{\n "num_gpu": 99\n}missing
1363Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_000223__42100.019.21960[184, 521]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_000223__421.json0.0missingmissingmissing
1364Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_011028__91100.09.835380[138, 163]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_011028__911.json0.0missing{\n "num_gpu": 99\n}missing
1365Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_011042__30800.014.37570[138, 248]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_011042__308.json25.0missing{\n "num_gpu": 99\n}missing
1366Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_000204__55200.023.09830[280, 582]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000204__552.json50.0missingmissingmissing
1367Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_011012__58700.016.83070[173, 97]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011012__587.json0.0missing{\n "num_gpu": 99\n}missing
1368Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_011018__22500.05.96430[173, 84]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011018__225.json0.0missing{\n "num_gpu": 99\n}missing
1369Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_000403__46000.027.57075[11, 712]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000403__460.json75.0missingmissingmissing
1370Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231225_011222__61400.013.72060[155, 235]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011222__614.json25.0missing{\n "num_gpu": 99\n}missing
1371Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_011224__15000.01.830380[155, 10]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011224__150.json0.0missing{\n "num_gpu": 99\n}missing
1372Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231214_000336__92200.029.64475[455, 660]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_000336__922.json75.0missingmissingmissing
1373Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231225_011157__31000.06.320420[152, 96]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_011157__310.json50.0missing{\n "num_gpu": 99\n}missing
1374Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_011209__85100.011.9950[152, 203]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_011209__851.json0.0missing{\n "num_gpu": 99\n}missing
1375Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_221134__94100.028.34440[1, 801]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_221134__941.json25.0missingmissingmissing
1376Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_221156__76400.022.18110[1, 643]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_221156__764.json25.0missingmissingmissing
1377Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_013715__31120.076.7083[163, 446]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_013715__311.json75.0missing{\n "num_gpu": 99\n}missing
1378Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_013820__73520.064.52193[163, 373]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_013820__735.json75.0missing{\n "num_gpu": 99\n}missing
1379Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_224506__86040.061.81665[163, 358]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_224506__860.json95.0missing{\n "num_gpu": 99\n}missing
1380Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_221035__97000.019.83040[1, 574]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221035__970.json25.0missingmissingmissing
1381Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_221047__53000.012.71030[1, 380]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221047__530.json25.0missingmissingmissing
1382Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_013454__63320.048.03125[204, 266]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_013454__633.json85.0missing{\n "num_gpu": 99\n}missing
1383Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_013558__93840.063.42255[204, 360]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_013558__938.json95.0missing{\n "num_gpu": 99\n}missing
1384Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_224403__93700.070.04143[204, 401]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_224403__937.json65.0missing{\n "num_gpu": 99\n}missing
1385Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_220931__30200.032.16390[1, 862]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220931__302.json25.0missingmissingmissing
1386Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_220959__91300.027.88320[1, 760]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220959__913.json25.0missingmissingmissing
1387Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_013307__76800.099.76985[299, 391]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_013307__768.json75.0missing{\n "num_gpu": 99\n}missing
1388Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_013406__96410.058.50011[299, 313]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_013406__964.json60.0missing{\n "num_gpu": 99\n}missing
1389Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_224253__45400.0101.6995[299, 434]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_224253__454.json75.0missing{\n "num_gpu": 99\n}missing
1390Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_221525__24100.024.05770[1, 635]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_221525__241.json0.0missingmissingmissing
1391Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_221601__25700.036.31650[1, 919]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_221601__257.json25.0missingmissingmissing
1392Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_014431__54600.064.52480[492, 314]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_014431__546.json50.0missing{\n "num_gpu": 99\n}missing
1393Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_014547__60500.075.08920[492, 376]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_014547__605.json50.0missing{\n "num_gpu": 99\n}missing
1394Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_224808__42640.079.42195[492, 403]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_224808__426.json95.0missing{\n "num_gpu": 99\n}missing
1395Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_221412__64300.011.21380[1, 311]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_221412__643.json0.0missingmissingmissing
1396Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_221436__32300.024.86540[1, 655]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_221436__323.json0.0missingmissingmissing
1397Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_014210__19800.078.92520[490, 394]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014210__198.json50.0missing{\n "num_gpu": 99\n}missing
1398Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_014326__61130.075.40094[490, 378]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014326__611.json85.0missing{\n "num_gpu": 99\n}missing
1399Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_224648__51000.0101.8474[490, 534]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_224648__510.json70.0missing{\n "num_gpu": 99\n}missing
1400Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231226_225705__39900.010.72130[156, 398]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_225705__399.json0.0missing{\n "num_gpu": 99\n}missing
1401Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_104415__88400.014.12650[156, 522]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_104415__884.json25.0missing{\n "num_gpu": 99\n}missing
1402Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_104431__81000.015.92380[156, 587]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_104431__810.json0.0missing{\n "num_gpu": 99\n}missing
1403Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_104529__73500.058.07080[156, 1904]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_104529__735.json0.0missing{\n "num_gpu": 99\n}missing
1404Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_225654__50500.010.02860[193, 363]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_225654__505.json0.0missing{\n "num_gpu": 99\n}missing
1405Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_104348__70600.08.953640[193, 323]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_104348__706.json0.0missing{\n "num_gpu": 99\n}missing
1406Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_104356__34800.07.535890[193, 269]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_104356__348.json0.0missing{\n "num_gpu": 99\n}missing
1407Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_104401__48500.05.21680[193, 181]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_104401__485.json0.0missing{\n "num_gpu": 99\n}missing
1408Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_225644__40300.010.28090[277, 230]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225644__403.json25.0missing{\n "num_gpu": 99\n}missing
1409Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_104325__36100.015.1580[277, 406]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104325__361.json25.0missing{\n "num_gpu": 99\n}missing
1410Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_104330__50200.04.856950[277, 155]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104330__502.json0.0missing{\n "num_gpu": 99\n}missing
1411Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_104339__87000.09.729860[277, 337]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104339__870.json0.0missing{\n "num_gpu": 99\n}missing
1412Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_225723__34900.07.115060[445, 209]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225723__349.json0.0missing{\n "num_gpu": 99\n}missing
1413Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_104605__76100.05.719870[445, 158]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104605__761.json0.0missing{\n "num_gpu": 99\n}missing
1414Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_104616__17900.010.75180[445, 339]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104616__179.json0.0missing{\n "num_gpu": 99\n}missing
1415Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_104625__90800.08.865370[445, 272]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104625__908.json25.0missing{\n "num_gpu": 99\n}missing
1416Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231226_225715__37300.010.45320[442, 329]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_225715__373.json0.0missing{\n "num_gpu": 99\n}missing
1417Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_104539__73700.09.622270[442, 299]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_104539__737.json0.0missing{\n "num_gpu": 99\n}missing
1418Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_104549__77900.010.11830[442, 317]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_104549__779.json0.0missing{\n "num_gpu": 99\n}missing
1419Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_104559__63700.010.47920[442, 330]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_104559__637.json0.0missing{\n "num_gpu": 99\n}missing
1420Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruetrue520231213_235150__11200.019.7860[155, 549]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231213_235150__112.json50.0missingmissingmissing
1421Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruetrue520231225_004306__66600.021.82070[155, 604]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231225_004306__666.json50.0missing{\n "num_gpu": 99\n}missing
1422Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruefalse520231225_004338__46600.031.21680[1, 870]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231225_004338__466.json25.0missing{\n "num_gpu": 99\n}missing
1423Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruefalse520231226_222057__32600.030.05190[155, 825]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231226_222057__326.json25.0missing{\n "num_gpu": 99\n}missing
1424Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTfalsefalse520231213_235131__65100.016.26520[184, 442]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231213_235131__651.json0.0missingmissingmissing
1425Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTtruetrue520231225_004227__39610.021.30751[184, 576]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_004227__396.json60.0missing{\n "num_gpu": 99\n}missing
1426Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTfalsefalse520231225_004245__37800.017.45890[1, 509]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_004245__378.json0.0missing{\n "num_gpu": 99\n}missing
1427Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTtruetrue520231226_222027__99910.020.01485[184, 550]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_222027__999.json80.0missing{\n "num_gpu": 99\n}missing
1428Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTtruetrue520231213_235114__37700.030.67950[280, 772]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235114__377.json50.0missingmissingmissing
1429Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_004134__85200.043.3740[298, 945]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004134__852.json0.0missing{\n "num_gpu": 99\n}missing
1430Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTtruetrue520231225_004205__40900.031.02045[1, 834]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004205__409.json75.0missing{\n "num_gpu": 99\n}missing
1431Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTtruefalse520231226_222006__79600.031.54840[298, 679]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222006__796.json25.0missing{\n "num_gpu": 99\n}missing
1432Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTfalsefalse520231213_235252__66500.014.28540[11, 384]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235252__665.json0.0missingmissingmissing
1433Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_004549__74400.022.77650[11, 597]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004549__744.json0.0missing{\n "num_gpu": 99\n}missing
1434Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_004600__95200.010.56040[1, 293]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004600__952.json0.0missing{\n "num_gpu": 99\n}missing
1435Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTtruetrue520231226_222147__48200.019.18784[11, 515]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222147__482.json70.0missing{\n "num_gpu": 99\n}missing
1436Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruetrue520231213_235238__34400.027.64860[455, 612]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231213_235238__344.json50.0missingmissingmissing
1437Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruefalse520231225_004453__96400.031.77420[455, 710]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_004453__964.json25.0missing{\n "num_gpu": 99\n}missing
1438Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruetrue520231225_004526__96100.032.50245[1, 832]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_004526__961.json75.0missing{\n "num_gpu": 99\n}missing
1439Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruetrue520231226_222128__36400.030.8590[455, 697]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_222128__364.json50.0missing{\n "num_gpu": 99\n}missing
1440Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruefalse520231214_000501__87400.022.05510[155, 610]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231214_000501__874.json25.0missingmissingmissing
1441Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231225_011327__48710.010.24325[155, 322]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231225_011327__487.json80.0missing{\n "num_gpu": 99\n}missing
1442Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231225_011338__60030.011.16295[155, 352]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231225_011338__600.json90.0missing{\n "num_gpu": 99\n}missing
1443Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231226_223209__71310.013.975[155, 443]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231226_223209__713.json80.0missing{\n "num_gpu": 99\n}missing
1444Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruetrue520231214_000439__59500.015.70730[184, 426]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_000439__595.json50.0missingmissingmissing
1445Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruefalse520231225_011308__12500.011.66620[194, 358]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_011308__125.json25.0missing{\n "num_gpu": 99\n}missing
1446Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruefalse520231225_011317__26000.08.348740[194, 249]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_011317__260.json25.0missing{\n "num_gpu": 99\n}missing
1447Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruetrue520231226_223155__71330.012.92775[194, 399]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_223155__713.json90.0missing{\n "num_gpu": 99\n}missing
1448Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_000423__70600.019.8930[280, 499]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000423__706.json0.0missingmissingmissing
1449Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_011243__11900.018.50835[290, 366]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011243__119.json75.0missing{\n "num_gpu": 99\n}missing
1450Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_011256__74830.013.2025[290, 387]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011256__748.json90.0missing{\n "num_gpu": 99\n}missing
1451Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTtruefalse520231226_223142__49900.018.61420[290, 377]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223142__499.json25.0missing{\n "num_gpu": 99\n}missing
1452Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruefalse520231214_000617__57600.016.87560[11, 450]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000617__576.json25.0missingmissingmissing
1453Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_011437__58130.013.5535[458, 366]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011437__581.json90.0missing{\n "num_gpu": 99\n}missing
1454Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_011450__10530.012.62295[458, 338]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011450__105.json90.0missing{\n "num_gpu": 99\n}missing
1455Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_223237__83410.016.38325[458, 453]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223237__834.json80.0missing{\n "num_gpu": 99\n}missing
1456Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruefalse520231214_000600__23400.038.2250[455, 859]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_000600__234.json25.0missingmissingmissing
1457Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231225_011411__73630.012.39475[455, 331]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_011411__736.json90.0missing{\n "num_gpu": 99\n}missing
1458Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231225_011424__23700.012.87640[455, 345]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_011424__237.json50.0missing{\n "num_gpu": 99\n}missing
1459Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231226_223220__34930.010.88985[455, 284]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_223220__349.json90.0missing{\n "num_gpu": 99\n}missing
1460Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175508__51740.017.76215[155, 336]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175508__517.json95.0missing{\n "num_gpu": 99\n}missing
1461Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175526__83630.017.35465[155, 328]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175526__836.json90.0missing{\n "num_gpu": 99\n}missing
1462Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175545__22040.019.04765[155, 361]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175545__220.json95.0missing{\n "num_gpu": 99\n}missing
1463Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175409__23430.014.91095[194, 273]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175409__234.json90.0missing{\n "num_gpu": 99\n}missing
1464Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_175431__21800.021.55990[194, 402]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175431__218.json25.0missing{\n "num_gpu": 99\n}missing
1465Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175450__89930.019.5215[194, 363]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175450__899.json90.0missing{\n "num_gpu": 99\n}missing
1466Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_175308__70300.023.29915[290, 422]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175308__703.json75.0missing{\n "num_gpu": 99\n}missing
1467Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_175333__48900.024.94735[290, 453]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175333__489.json75.0missing{\n "num_gpu": 99\n}missing
1468Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_175354__76700.020.90695[290, 376]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175354__767.json75.0missing{\n "num_gpu": 99\n}missing
1469Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175713__59330.024.23535[458, 416]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175713__593.json90.0missing{\n "num_gpu": 99\n}missing
1470Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175726__49630.012.35695[458, 191]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175726__496.json90.0missing{\n "num_gpu": 99\n}missing
1471Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175737__91830.011.19685[458, 169]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175737__918.json90.0missing{\n "num_gpu": 99\n}missing
1472Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175608__76130.022.63195[455, 386]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175608__761.json90.0missing{\n "num_gpu": 99\n}missing
1473Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175628__75130.019.97835[455, 336]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175628__751.json90.0missing{\n "num_gpu": 99\n}missing
1474Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175649__15540.021.20015[455, 359]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175649__155.json95.0missing{\n "num_gpu": 99\n}missing
1475Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_222501__87100.026.77590[1, 762]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_222501__871.json25.0missingmissingmissing
1476Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_222521__41900.020.14130[1, 589]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_222521__419.json25.0missingmissingmissing
1477Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_015119__35600.014.3970[157, 350]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_015119__356.json25.0missing{\n "num_gpu": 99\n}missing
1478Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_015136__51700.017.38610[157, 425]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_015136__517.json50.0missing{\n "num_gpu": 99\n}missing
1479Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_225055__30330.016.64695[157, 406]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_225055__303.json90.0missing{\n "num_gpu": 99\n}missing
1480Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_222400__18700.012.96630[1, 387]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_222400__187.json25.0missingmissingmissing
1481Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_222416__11600.015.45090[1, 456]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_222416__116.json25.0missingmissingmissing
1482Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015056__68510.016.28271[198, 388]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015056__685.json60.0missing{\n "num_gpu": 99\n}missing
1483Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015104__15200.07.983441[198, 177]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015104__152.json55.0missing{\n "num_gpu": 99\n}missing
1484Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_225039__62500.07.077080[198, 154]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_225039__625.json0.0missing{\n "num_gpu": 99\n}missing
1485Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_222315__71100.023.94040[1, 662]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222315__711.json25.0missingmissingmissing
1486Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_222334__35400.018.56040[1, 525]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222334__354.json25.0missingmissingmissing
1487Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_015037__42400.022.46480[294, 381]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015037__424.json25.0missing{\n "num_gpu": 99\n}missing
1488Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_015040__83800.02.926540[294, 33]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015040__838.json0.0missing{\n "num_gpu": 99\n}missing
1489Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_225031__14320.028.36015[294, 536]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225031__143.json85.0missing{\n "num_gpu": 99\n}missing
1490Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_222740__42700.021.84170[1, 581]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222740__427.json0.0missingmissingmissing
1491Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_222801__83700.020.34790[1, 544]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222801__837.json0.0missingmissingmissing
1492Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015307__19900.021.1050[465, 460]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015307__199.json50.0missing{\n "num_gpu": 99\n}missing
1493Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015329__39200.021.88490[465, 479]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015329__392.json50.0missing{\n "num_gpu": 99\n}missing
1494Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_225136__67900.018.85990[465, 406]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225136__679.json50.0missing{\n "num_gpu": 99\n}missing
1495Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_222712__89200.010.73210[1, 298]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222712__892.json0.0missingmissingmissing
1496Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_222714__34300.02.155990[1, 62]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222714__343.json0.0missingmissingmissing
1497Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_015224__95300.017.2050[463, 366]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015224__953.json25.0missing{\n "num_gpu": 99\n}missing
1498Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_015246__44200.021.78915[463, 477]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015246__442.json75.0missing{\n "num_gpu": 99\n}missing
1499Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231226_225117__78000.022.10630[463, 484]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_225117__780.json25.0missing{\n "num_gpu": 99\n}missing
1500Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225911__71510.015.93331[156, 490]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225911__715.json60.0missing{\n "num_gpu": 99\n}missing
1501Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225922__29300.010.30670[156, 312]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225922__293.json50.0missing{\n "num_gpu": 99\n}missing
1502Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225933__47840.011.79454[156, 360]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225933__478.json90.0missing{\n "num_gpu": 99\n}missing
1503Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225945__89410.011.17021[156, 340]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225945__894.json60.0missing{\n "num_gpu": 99\n}missing
1504Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225958__79910.012.48731[156, 382]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225958__799.json60.0missing{\n "num_gpu": 99\n}missing
1505Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225830__50900.05.705080[197, 150]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225830__509.json50.0missing{\n "num_gpu": 99\n}missing
1506Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225837__54010.06.698681[197, 186]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225837__540.json60.0missing{\n "num_gpu": 99\n}missing
1507Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225842__23210.05.736665[197, 155]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225842__232.json80.0missing{\n "num_gpu": 99\n}missing
1508Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_225849__57300.06.532780[197, 181]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225849__573.json0.0missing{\n "num_gpu": 99\n}missing
1509Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225855__59410.06.154351[197, 169]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225855__594.json60.0missing{\n "num_gpu": 99\n}missing
1510Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225714__83110.016.06151[293, 439]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225714__831.json60.0missing{\n "num_gpu": 99\n}missing
1511Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225732__52710.018.30421[293, 531]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225732__527.json60.0missing{\n "num_gpu": 99\n}missing
1512Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_225748__66600.015.70050[293, 452]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225748__666.json25.0missing{\n "num_gpu": 99\n}missing
1513Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225807__16020.019.19784[293, 559]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225807__160.json80.0missing{\n "num_gpu": 99\n}missing
1514Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225823__36720.014.80735[293, 425]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225823__367.json85.0missing{\n "num_gpu": 99\n}missing
1515Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230132__80030.013.18294[464, 344]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230132__800.json85.0missing{\n "num_gpu": 99\n}missing
1516Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230148__51010.015.21761[464, 405]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230148__510.json60.0missing{\n "num_gpu": 99\n}missing
1517Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230159__63810.011.31181[464, 286]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230159__638.json60.0missing{\n "num_gpu": 99\n}missing
1518Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_230216__98100.016.31780[464, 438]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230216__981.json25.0missing{\n "num_gpu": 99\n}missing
1519Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230231__70410.015.03261[464, 399]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230231__704.json60.0missing{\n "num_gpu": 99\n}missing
1520Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_230020__40810.022.11621[462, 608]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230020__408.json60.0missing{\n "num_gpu": 99\n}missing
1521Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_230033__63110.013.19951[462, 344]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230033__631.json60.0missing{\n "num_gpu": 99\n}missing
1522Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_230046__36510.012.38231[462, 319]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230046__365.json60.0missing{\n "num_gpu": 99\n}missing
1523Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_230102__39100.015.83780[462, 423]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230102__391.json25.0missing{\n "num_gpu": 99\n}missing
1524Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_230119__92000.017.29610[462, 467]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230119__920.json0.0missing{\n "num_gpu": 99\n}missing
1525Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230518__13900.021.16330[156, 517]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230518__139.json50.0missing{\n "num_gpu": 99\n}missing
1526Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230537__92400.018.88780[156, 461]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230537__924.json50.0missing{\n "num_gpu": 99\n}missing
1527Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230551__19200.013.77870[156, 333]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230551__192.json50.0missing{\n "num_gpu": 99\n}missing
1528Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230606__19700.015.29590[156, 371]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230606__197.json50.0missing{\n "num_gpu": 99\n}missing
1529Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230621__31500.014.50720[156, 351]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230621__315.json50.0missing{\n "num_gpu": 99\n}missing
1530Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230421__67620.08.718034[197, 195]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230421__676.json80.0missing{\n "num_gpu": 99\n}missing
1531Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230430__10410.08.811391[197, 197]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230430__104.json60.0missing{\n "num_gpu": 99\n}missing
1532Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230437__21640.07.285735[197, 158]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230437__216.json95.0missing{\n "num_gpu": 99\n}missing
1533Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230446__22800.08.342640[197, 185]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230446__228.json50.0missing{\n "num_gpu": 99\n}missing
1534Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230457__68810.010.75991[197, 247]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230457__688.json60.0missing{\n "num_gpu": 99\n}missing
1535Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230258__15000.026.87345[293, 608]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230258__150.json75.0missing{\n "num_gpu": 99\n}missing
1536Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230311__19220.013.59035[293, 303]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230311__192.json85.0missing{\n "num_gpu": 99\n}missing
1537Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230325__75800.013.40330[293, 298]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230325__758.json50.0missing{\n "num_gpu": 99\n}missing
1538Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230345__69900.020.28520[293, 468]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230345__699.json50.0missing{\n "num_gpu": 99\n}missing
1539Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230412__40000.026.89610[293, 628]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230412__400.json50.0missing{\n "num_gpu": 99\n}missing
1540Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_230835__73000.022.92440[464, 501]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230835__730.json0.0missing{\n "num_gpu": 99\n}missing
1541Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_230856__89030.019.99974[464, 432]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230856__890.json85.0missing{\n "num_gpu": 99\n}missing
1542Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_230914__40120.018.14122[464, 387]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230914__401.json70.0missing{\n "num_gpu": 99\n}missing
1543Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_230940__87100.026.45020[464, 585]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230940__871.json50.0missing{\n "num_gpu": 99\n}missing
1544Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_231009__82300.028.4950[464, 633]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231009__823.json25.0missing{\n "num_gpu": 99\n}missing
1545Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230638__87110.017.10581[462, 362]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230638__871.json60.0missing{\n "num_gpu": 99\n}missing
1546Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230655__12710.016.96491[462, 358]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230655__127.json60.0missing{\n "num_gpu": 99\n}missing
1547Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230724__74050.028.53645[462, 634]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230724__740.json100.0missing{\n "num_gpu": 99\n}missing
1548Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230747__17450.022.47995[462, 491]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230747__174.json100.0missing{\n "num_gpu": 99\n}missing
1549Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230812__21940.024.75665[462, 545]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230812__219.json95.0missing{\n "num_gpu": 99\n}missing
1550Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120640__91710.018.23281[156, 322]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120640__917.json60.0missing{\n "num_gpu": 99\n}missing
1551Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120701__30900.020.55660[156, 366]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120701__309.json50.0missing{\n "num_gpu": 99\n}missing
1552Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_225530__42410.019.86291[156, 356]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_225530__424.json60.0missing{\n "num_gpu": 99\n}missing
1553Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_120612__40200.08.816050[197, 142]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120612__402.json0.0missing{\n "num_gpu": 99\n}missing
1554Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_120622__86000.09.828260[197, 159]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120622__860.json0.0missing{\n "num_gpu": 99\n}missing
1555Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_225509__75610.011.41691[197, 192]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_225509__756.json60.0missing{\n "num_gpu": 99\n}missing
1556Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120535__34900.032.03540[293, 553]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120535__349.json50.0missing{\n "num_gpu": 99\n}missing
1557Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120603__95500.027.75790[293, 476]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120603__955.json50.0missing{\n "num_gpu": 99\n}missing
1558Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_225458__60500.034.05640[293, 436]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225458__605.json25.0missing{\n "num_gpu": 99\n}missing
1559Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120903__19720.021.43055[464, 338]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120903__197.json85.0missing{\n "num_gpu": 99\n}missing
1560Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120931__93810.028.30091[464, 455]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120931__938.json60.0missing{\n "num_gpu": 99\n}missing
1561Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_225633__64410.023.7331[464, 385]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225633__644.json60.0missing{\n "num_gpu": 99\n}missing
1562Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120809__43320.024.92994[462, 396]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120809__433.json80.0missing{\n "num_gpu": 99\n}missing
1563Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_120842__82800.032.29730[462, 522]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120842__828.json25.0missing{\n "num_gpu": 99\n}missing
1564Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_225609__67610.038.97941[462, 655]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_225609__676.json60.0missing{\n "num_gpu": 99\n}missing
1565Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_105356__46230.061.91225[159, 340]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_105356__462.json90.0missing{\n "num_gpu": 99\n}missing
1566Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_105529__38810.093.09291[159, 507]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_105529__388.json60.0missing{\n "num_gpu": 99\n}missing
1567Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_105614__47120.045.04025[159, 250]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_105614__471.json85.0missing{\n "num_gpu": 99\n}missing
1568Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_143856__83200.056.17720[159, 318]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_143856__832.json50.0missing{\n "num_gpu": 99\n}missing
1569Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_144018__12630.081.22814[159, 467]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_144018__126.json85.0missing{\n "num_gpu": 99\n}missing
1570Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_105135__10810.059.15672[198, 327]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_105135__108.json65.0missing{\n "num_gpu": 99\n}missing
1571Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_105223__82300.047.54280[198, 257]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_105223__823.json0.0missing{\n "num_gpu": 99\n}missing
1572Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_105254__28400.030.50510[198, 154]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_105254__284.json0.0missing{\n "num_gpu": 99\n}missing
1573Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_143710__84000.039.99770[198, 208]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_143710__840.json0.0missing{\n "num_gpu": 99\n}missing
1574Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_143800__64200.050.47850[198, 274]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_143800__642.json50.0missing{\n "num_gpu": 99\n}missing
1575Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_104819__42000.0113.6633[290, 598]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104819__420.json65.0missing{\n "num_gpu": 99\n}missing
1576Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_104945__83710.086.15741[290, 469]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104945__837.json60.0missing{\n "num_gpu": 99\n}missing
1577Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_105036__26000.050.69960[290, 260]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_105036__260.json0.0missing{\n "num_gpu": 99\n}missing
1578Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_143459__83610.073.79591[290, 395]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_143459__836.json60.0missing{\n "num_gpu": 99\n}missing
1579Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_143628__84120.087.83325[290, 477]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_143628__841.json85.0missing{\n "num_gpu": 99\n}missing
1580Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_110048__24700.012.60120[472, 4]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110048__247.json0.0missing{\n "num_gpu": 99\n}missing
1581Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_110146__67500.058.83940[472, 278]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110146__675.json50.0missing{\n "num_gpu": 99\n}missing
1582Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_110159__43100.012.71260[472, 5]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110159__431.json0.0missing{\n "num_gpu": 99\n}missing
1583Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_144503__85900.0122.7080[472, 641]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_144503__859.json50.0missing{\n "num_gpu": 99\n}missing
1584Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_144516__72000.012.75860[472, 4]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_144516__720.json0.0missing{\n "num_gpu": 99\n}missing
1585Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_105756__50710.0100.4524[470, 516]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_105756__507.json75.0missing{\n "num_gpu": 99\n}missing
1586Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_105946__36940.0110.0035[470, 571]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_105946__369.json95.0missing{\n "num_gpu": 99\n}missing
1587Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_110035__18810.048.39915[470, 216]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_110035__188.json80.0missing{\n "num_gpu": 99\n}missing
1588Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_144048__87200.030.17510[470, 108]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_144048__872.json0.0missing{\n "num_gpu": 99\n}missing
1589Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_144300__96430.0131.4595[470, 690]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_144300__964.json90.0missing{\n "num_gpu": 99\n}missing
1590Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_223056__31600.019.34160[1, 568]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_223056__316.json0.0missingmissingmissing
1591Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_223115__85700.018.60610[1, 548]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_223115__857.json25.0missingmissingmissing
1592Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_015450__73500.012.95474[165, 309]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_015450__735.json70.0missing{\n "num_gpu": 99\n}missing
1593Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_015502__14120.012.22393[165, 290]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_015502__141.json75.0missing{\n "num_gpu": 99\n}missing
1594Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231226_225220__81400.015.55511[165, 374]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_225220__814.json55.0missing{\n "num_gpu": 99\n}missing
1595Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_223004__44400.020.68220[1, 597]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_223004__444.json0.0missingmissingmissing
1596Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_223017__78100.013.10260[1, 391]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_223017__781.json25.0missingmissingmissing
1597Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015420__72300.09.123534[206, 206]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015420__723.json70.0missing{\n "num_gpu": 99\n}missing
1598Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015437__18200.016.2030[206, 385]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015437__182.json50.0missing{\n "num_gpu": 99\n}missing
1599Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_225205__40300.010.03764[206, 229]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_225205__403.json70.0missing{\n "num_gpu": 99\n}missing
1600Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_222906__16300.024.12870[1, 667]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222906__163.json0.0missingmissingmissing
1601Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_222928__14300.022.0210[1, 614]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222928__143.json25.0missingmissingmissing
1602Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_015351__83000.021.91911[302, 353]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015351__830.json55.0missing{\n "num_gpu": 99\n}missing
1603Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_015411__15000.019.11491[302, 440]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015411__150.json55.0missing{\n "num_gpu": 99\n}missing
1604Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_225154__41910.017.85481[302, 261]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225154__419.json60.0missing{\n "num_gpu": 99\n}missing
1605Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_223448__91200.08.528380[1, 239]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_223448__912.json0.0missingmissingmissing
1606Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_223528__14000.040.04950[1, 1002]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_223528__140.json25.0missingmissingmissing
1607Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015618__11000.011.59960[473, 228]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015618__110.json50.0missing{\n "num_gpu": 99\n}missing
1608Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015639__11440.021.01265[473, 457]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015639__114.json95.0missing{\n "num_gpu": 99\n}missing
1609Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_225301__73500.023.88410[473, 525]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225301__735.json50.0missing{\n "num_gpu": 99\n}missing
1610Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_223336__63700.022.22860[1, 591]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_223336__637.json0.0missingmissingmissing
1611Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_223437__87500.060.92320[1, 1436]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_223437__875.json25.0missingmissingmissing
1612Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_015551__44720.015.78965[471, 331]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015551__447.json85.0missing{\n "num_gpu": 99\n}missing
1613Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_015607__44140.014.62845[471, 302]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015607__441.json95.0missing{\n "num_gpu": 99\n}missing
1614Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_225237__86620.015.6555[471, 327]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_225237__866.json85.0missing{\n "num_gpu": 99\n}missing
1615Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruefalse520231213_235345__28500.016.7540[155, 466]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_235345__285.json25.0missingmissingmissing
1616Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_004718__66040.013.355[163, 411]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_004718__660.json95.0missing{\n "num_gpu": 99\n}missing
1617Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_004728__70010.09.082861[163, 269]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_004728__700.json60.0missing{\n "num_gpu": 99\n}missing
1618Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231226_222238__99650.013.99875[163, 433]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_222238__996.json100.0missing{\n "num_gpu": 99\n}missing
1619Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231213_235328__80700.016.7983[184, 455]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_235328__807.json65.0missingmissingmissing
1620Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_004654__13140.011.31955[204, 339]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_004654__131.json95.0missing{\n "num_gpu": 99\n}missing
1621Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_004704__35920.010.47135[204, 312]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_004704__359.json85.0missing{\n "num_gpu": 99\n}missing
1622Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_222224__60630.012.87945[204, 390]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_222224__606.json90.0missing{\n "num_gpu": 99\n}missing
1623Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231213_235311__72200.018.76380[280, 469]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235311__722.json0.0missingmissingmissing
1624Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_004624__36030.024.49815[300, 563]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004624__360.json90.0missing{\n "num_gpu": 99\n}missing
1625Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_004642__26300.015.87724[300, 459]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004642__263.json70.0missing{\n "num_gpu": 99\n}missing
1626Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_222210__35740.022.58585[300, 518]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222210__357.json95.0missing{\n "num_gpu": 99\n}missing
1627Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231213_235451__68200.017.90510[11, 476]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235451__682.json50.0missingmissingmissing
1628Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_004854__82710.018.62272[471, 513]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004854__827.json65.0missing{\n "num_gpu": 99\n}missing
1629Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_004907__39700.013.10660[471, 344]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004907__397.json50.0missing{\n "num_gpu": 99\n}missing
1630Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231226_222311__48230.018.41365[471, 508]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222311__482.json90.0missing{\n "num_gpu": 99\n}missing
1631Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231213_235433__82900.024.12980[455, 525]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_235433__829.json25.0missingmissingmissing
1632Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_004815__30500.016.7971[469, 458]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_004815__305.json55.0missing{\n "num_gpu": 99\n}missing
1633Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_004834__68830.019.67665[469, 545]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_004834__688.json90.0missing{\n "num_gpu": 99\n}missing
1634Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_222252__80540.012.96995[469, 339]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_222252__805.json95.0missing{\n "num_gpu": 99\n}missing
1635Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231214_001026__19700.022.03280[155, 609]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231214_001026__197.json0.0missingmissingmissing
1636Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231225_011805__32000.04.341590[158, 58]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231225_011805__320.json0.0missing{\n "num_gpu": 99\n}missing
1637Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231225_011808__69400.03.939890[158, 50]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231225_011808__694.json0.0missing{\n "num_gpu": 99\n}missing
1638Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231226_223358__77600.02.814360[158, 29]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231226_223358__776.json0.0missing{\n "num_gpu": 99\n}missing
1639Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_001004__10600.019.4450[184, 527]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_001004__106.json50.0missingmissingmissing
1640Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_011744__36000.020.53120[197, 348]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_011744__360.json0.0missing{\n "num_gpu": 99\n}missing
1641Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTtruetrue520231225_011800__70000.016.53770[197, 275]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_011800__700.json50.0missing{\n "num_gpu": 99\n}missing
1642Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_223355__62100.019.97850[197, 339]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_223355__621.json0.0missing{\n "num_gpu": 99\n}missing
1643Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231214_000944__71400.024.45970[280, 617]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000944__714.json0.0missingmissingmissing
1644Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_011657__56800.039.39850[293, 492]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011657__568.json0.0missing{\n "num_gpu": 99\n}missing
1645Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_011723__74110.026.13961[293, 428]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011723__741.json60.0missing{\n "num_gpu": 99\n}missing
1646Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_223335__73300.016.84040[293, 96]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223335__733.json0.0missing{\n "num_gpu": 99\n}missing
1647Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_001129__33400.020.64361[11, 545]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_001129__334.json55.0missingmissingmissing
1648Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_012022__43600.032.7921[461, 507]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_012022__436.json55.0missing{\n "num_gpu": 99\n}missing
1649Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_012111__65810.048.85751[461, 771]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_012111__658.json60.0missing{\n "num_gpu": 99\n}missing
1650Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231226_223527__44400.062.30470[461, 988]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223527__444.json50.0missing{\n "num_gpu": 99\n}missing
1651Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTtruetrue520231214_001108__86610.020.53631[455, 435]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_001108__866.json60.0missingmissingmissing
1652Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_011907__69700.051.0670[458, 808]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_011907__697.json0.0missing{\n "num_gpu": 99\n}missing
1653Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTtruefalse520231225_011949__18100.041.95740[458, 660]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_011949__181.json25.0missing{\n "num_gpu": 99\n}missing
1654Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_223425__68000.027.06790[458, 412]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_223425__680.json0.0missing{\n "num_gpu": 99\n}missing
1655Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_223809__38700.022.59970[1, 654]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_223809__387.json25.0missingmissingmissing
1656Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_223824__22100.015.1010[1, 452]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_223824__221.json25.0missingmissingmissing
1657Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_015713__95200.010.98630[150, 410]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_015713__952.json0.0missing{\n "num_gpu": 99\n}missing
1658Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_015735__75300.021.7130[150, 793]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_015735__753.json0.0missing{\n "num_gpu": 99\n}missing
1659Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231226_225402__34300.021.02310[150, 767]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_225402__343.json0.0missing{\n "num_gpu": 99\n}missing
1660Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_223711__41100.017.58830[1, 514]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_223711__411.json25.0missingmissingmissing
1661Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_223724__62200.012.62060[1, 377]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_223724__622.json25.0missingmissingmissing
1662Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_015656__12900.05.435240[187, 193]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_015656__129.json0.0missing{\n "num_gpu": 99\n}missing
1663Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_015702__89500.06.336380[187, 228]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_015702__895.json0.0missing{\n "num_gpu": 99\n}missing
1664Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_225341__64700.028.31470[187, 1001]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_225341__647.json0.0missing{\n "num_gpu": 99\n}missing
1665Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_223616__49900.023.05830[1, 640]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_223616__499.json25.0missingmissingmissing
1666Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_223638__40500.021.27940[1, 595]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_223638__405.json25.0missingmissingmissing
1667Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_015644__46700.04.591220[271, 1]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015644__467.json0.0missing{\n "num_gpu": 99\n}missing
1668Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_015650__59800.06.328470[271, 211]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015650__598.json0.0missing{\n "num_gpu": 99\n}missing
1669Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_225312__59200.011.83170[271, 287]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225312__592.json0.0missing{\n "num_gpu": 99\n}missing
1670Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_224130__13800.021.22630[1, 566]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_224130__138.json25.0missingmissingmissing
1671Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_224150__47700.019.80110[1, 531]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_224150__477.json25.0missingmissingmissing
1672Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_015846__81800.01.507480[439, 1]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015846__818.json0.0missing{\n "num_gpu": 99\n}missing
1673Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_015852__13200.06.082360[439, 172]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015852__132.json0.0missing{\n "num_gpu": 99\n}missing
1674Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_225424__22400.011.80030[439, 377]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225424__224.json0.0missing{\n "num_gpu": 99\n}missing
1675Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_224028__82800.030.01080[1, 776]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_224028__828.json25.0missingmissingmissing
1676Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_224051__87500.022.7930[1, 605]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_224051__875.json25.0missingmissingmissing
1677Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_015817__40800.011.48970[436, 367]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_015817__408.json0.0missing{\n "num_gpu": 99\n}missing
1678Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_015844__87500.026.69790[436, 877]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_015844__875.json0.0missing{\n "num_gpu": 99\n}missing
1679Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_225412__77300.010.31720[436, 325]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_225412__773.json0.0missing{\n "num_gpu": 99\n}missing
1680Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231214_001231__24900.020.14940[155, 560]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_001231__249.json50.0missingmissingmissing
1681Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_012606__23840.049.71975[166, 368]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_012606__238.json95.0missing{\n "num_gpu": 99\n}missing
1682Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_012645__15240.038.55665[166, 280]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_012645__152.json95.0missing{\n "num_gpu": 99\n}missing
1683Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231226_223858__54530.054.13944[166, 399]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_223858__545.json85.0missing{\n "num_gpu": 99\n}missing
1684Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_001211__93200.018.32040[184, 497]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_001211__932.json0.0missingmissingmissing
1685Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_012433__78940.060.80315[205, 448]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_012433__789.json95.0missing{\n "num_gpu": 99\n}missing
1686Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_012516__36230.043.12074[205, 310]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_012516__362.json85.0missing{\n "num_gpu": 99\n}missing
1687Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_223804__21440.072.31955[205, 536]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_223804__214.json95.0missing{\n "num_gpu": 99\n}missing
1688Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231214_001153__39900.023.88050[280, 601]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_001153__399.json25.0missingmissingmissing
1689Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_012234__30400.083.16780[301, 425]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_012234__304.json50.0missing{\n "num_gpu": 99\n}missing
1690Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_012332__15030.057.58294[301, 404]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_012332__150.json85.0missing{\n "num_gpu": 99\n}missing
1691Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_223651__23340.084.05665[301, 448]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223651__233.json95.0missing{\n "num_gpu": 99\n}missing
1692Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_001401__28600.022.15830[11, 583]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_001401__286.json0.0missingmissingmissing
1693Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_013049__73700.031.70410[469, 172]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_013049__737.json50.0missing{\n "num_gpu": 99\n}missing
1694Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_013126__84600.036.88120[469, 212]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_013126__846.json50.0missing{\n "num_gpu": 99\n}missing
1695Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231226_224111__70610.079.26994[469, 534]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_224111__706.json75.0missing{\n "num_gpu": 99\n}missing
1696Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse520231214_001338__27400.036.49810[455, 820]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_001338__274.json0.0missingmissingmissing
1697Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_012925__62900.058.24510[466, 376]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_012925__629.json50.0missing{\n "num_gpu": 99\n}missing
1698Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_013018__30100.052.68040[466, 334]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_013018__301.json50.0missing{\n "num_gpu": 99\n}missing
1699Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_223952__40230.053.46974[466, 339]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_223952__402.json85.0missing{\n "num_gpu": 99\n}missing
1700Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_221841__40200.022.33480[1, 647]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_221841__402.json0.0missingmissingmissing
1701Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_221856__77800.015.49980[1, 463]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_221856__778.json25.0missingmissingmissing
1702Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_014735__13010.024.55351[165, 400]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_014735__130.json60.0missing{\n "num_gpu": 99\n}missing
1703Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_014806__32930.030.56155[165, 501]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_014806__329.json90.0missing{\n "num_gpu": 99\n}missing
1704Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231226_224921__44140.017.93425[165, 287]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_224921__441.json95.0missing{\n "num_gpu": 99\n}missing
1705Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_221744__17300.017.01510[1, 499]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221744__173.json25.0missingmissingmissing
1706Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_221800__38800.015.08740[1, 446]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221800__388.json25.0missingmissingmissing
1707Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_014655__74540.012.0785[206, 181]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_014655__745.json95.0missing{\n "num_gpu": 99\n}missing
1708Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_014710__49440.015.14465[206, 234]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_014710__494.json95.0missing{\n "num_gpu": 99\n}missing
1709Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_224903__94110.018.47891[206, 291]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_224903__941.json60.0missing{\n "num_gpu": 99\n}missing
1710Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_221646__91300.022.40570[1, 624]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_221646__913.json25.0missingmissingmissing
1711Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_221708__15100.022.07680[1, 613]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_221708__151.json0.0missingmissingmissing
1712Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_014624__26510.036.69741[302, 419]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_014624__265.json60.0missing{\n "num_gpu": 99\n}missing
1713Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_014643__69100.018.94240[302, 283]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_014643__691.json25.0missing{\n "num_gpu": 99\n}missing
1714Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_224844__30200.036.5180[302, 433]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_224844__302.json25.0missing{\n "num_gpu": 99\n}missing
1715Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_222224__47400.027.37630[1, 714]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222224__474.json25.0missingmissingmissing
1716Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_222233__22000.08.842170[1, 248]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222233__220.json0.0missingmissingmissing
1717Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_014957__44510.026.08561[473, 374]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_014957__445.json60.0missing{\n "num_gpu": 99\n}missing
1718Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015014__88240.017.05825[473, 225]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015014__882.json95.0missing{\n "num_gpu": 99\n}missing
1719Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_225002__87040.016.91785[473, 223]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225002__870.json95.0missing{\n "num_gpu": 99\n}missing
1720Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_222107__44600.032.46770[1, 833]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222107__446.json25.0missingmissingmissing
1721Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_222128__43700.021.25140[1, 567]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222128__437.json25.0missingmissingmissing
1722Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_014907__84700.023.51980[471, 332]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014907__847.json0.0missing{\n "num_gpu": 99\n}missing
1723Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_014930__75940.023.6145[471, 334]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014930__759.json95.0missing{\n "num_gpu": 99\n}missing
1724Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231226_224945__33900.024.58920[471, 350]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_224945__339.json0.0missing{\n "num_gpu": 99\n}missing
1725Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTtruefalse520231214_000734__12700.037.8660[155, 1005]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_000734__127.json25.0missingmissingmissing
1726Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTtruetrue520231225_011526__12200.07.112570[160, 385]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_011526__122.json50.0missing{\n "num_gpu": 99\n}missing
1727Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTtruetrue520231225_011530__44200.04.837470[160, 260]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_011530__442.json50.0missing{\n "num_gpu": 99\n}missing
1728Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTfalsefalse520231226_223300__85800.05.399520[160, 290]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_223300__858.json0.0missing{\n "num_gpu": 99\n}missing
1729Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_000656__21200.010.36170[184, 274]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_000656__212.json0.0missingmissingmissing
1730Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_011512__31900.06.826810[197, 356]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_011512__319.json0.0missing{\n "num_gpu": 99\n}missing
1731Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_011518__19500.06.858050[197, 358]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_011518__195.json0.0missing{\n "num_gpu": 99\n}missing
1732Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231226_223255__53500.07.711290[197, 402]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_223255__535.json0.0missing{\n "num_gpu": 99\n}missing
1733Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_000645__67400.028.49780[280, 717]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000645__674.json50.0missingmissingmissing
1734Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_011459__25100.09.181270[279, 310]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011459__251.json0.0missing{\n "num_gpu": 99\n}missing
1735Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231225_011505__70400.05.521490[279, 266]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011505__704.json25.0missing{\n "num_gpu": 99\n}missing
1736Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_223247__82300.010.10470[279, 365]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223247__823.json0.0missing{\n "num_gpu": 99\n}missing
1737Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231214_000920__65800.031.39780[11, 801]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000920__658.json25.0missingmissingmissing
1738Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_011611__81500.010.55910[447, 476]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011611__815.json0.0missing{\n "num_gpu": 99\n}missing
1739Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_011617__44200.06.675590[447, 283]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011617__442.json0.0missing{\n "num_gpu": 99\n}missing
1740Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_223318__26600.09.385550[447, 417]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223318__266.json50.0missing{\n "num_gpu": 99\n}missing
1741Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_000848__22510.054.93451[455, 1222]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_000848__225.json60.0missingmissingmissing
1742Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_011553__24500.06.959090[445, 297]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_011553__245.json25.0missing{\n "num_gpu": 99\n}missing
1743Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_011600__64600.06.796050[445, 290]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_011600__646.json25.0missing{\n "num_gpu": 99\n}missing
1744Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_223309__79600.08.710170[445, 384]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_223309__796.json50.0missing{\n "num_gpu": 99\n}missing
1745Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruetrue520231213_235544__48600.021.34020[155, 592]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_235544__486.json50.0missingmissingmissing
1746Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruefalse520231225_005028__20400.011.77930[165, 360]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_005028__204.json25.0missing{\n "num_gpu": 99\n}missing
1747Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruetrue520231225_005040__24310.011.60891[165, 355]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_005040__243.json60.0missing{\n "num_gpu": 99\n}missing
1748Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruetrue520231226_222355__59120.016.27793[165, 503]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_222355__591.json75.0missing{\n "num_gpu": 99\n}missing
1749Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231213_235522__67200.015.88410[184, 430]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_235522__672.json50.0missingmissingmissing
1750Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_004959__93010.016.76391[206, 509]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_004959__930.json60.0missing{\n "num_gpu": 99\n}missing
1751Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_005016__85000.017.61940[206, 537]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_005016__850.json50.0missing{\n "num_gpu": 99\n}missing
1752Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_222339__48930.09.946975[206, 295]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_222339__489.json90.0missing{\n "num_gpu": 99\n}missing
1753Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231213_235507__28900.015.26820[280, 374]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235507__289.json25.0missingmissingmissing
1754Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_004929__93810.021.30531[302, 458]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004929__938.json60.0missing{\n "num_gpu": 99\n}missing
1755Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_004942__58210.012.47311[302, 355]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004942__582.json60.0missing{\n "num_gpu": 99\n}missing
1756Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231226_222328__41310.016.69661[302, 328]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222328__413.json60.0missing{\n "num_gpu": 99\n}missing
1757Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231213_235729__85200.020.51050[11, 542]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235729__852.json0.0missingmissingmissing
1758Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_005152__91010.019.15911[473, 528]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_005152__910.json60.0missing{\n "num_gpu": 99\n}missing
1759Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_005215__30200.022.38860[473, 623]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_005215__302.json50.0missing{\n "num_gpu": 99\n}missing
1760Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_222423__13310.013.68711[473, 364]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222423__133.json60.0missing{\n "num_gpu": 99\n}missing
1761Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231213_235708__18000.052.93460[455, 1179]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_235708__180.json0.0missingmissingmissing
1762Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_005119__44700.016.26180[471, 441]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_005119__447.json50.0missing{\n "num_gpu": 99\n}missing
1763Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_005133__34710.013.56241[471, 360]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_005133__347.json60.0missing{\n "num_gpu": 99\n}missing
1764Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_222409__34330.013.70295[471, 364]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_222409__343.json90.0missing{\n "num_gpu": 99\n}missing
1765Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231213_235828__99700.018.39430[155, 512]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_235828__997.json50.0missingmissingmissing
1766Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231225_005721__41050.077.15165[159, 563]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_005721__410.json100.0missing{\n "num_gpu": 99\n}missing
1767Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231225_005806__14920.043.16523[159, 306]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_005806__149.json75.0missing{\n "num_gpu": 99\n}missing
1768Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231226_222726__45640.070.18575[159, 514]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_222726__456.json95.0missing{\n "num_gpu": 99\n}missing
1769Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231213_235809__68700.017.330[184, 469]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_235809__687.json50.0missingmissingmissing
1770Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_005513__72020.050.49125[198, 354]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_005513__720.json85.0missing{\n "num_gpu": 99\n}missing
1771Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_005604__98930.050.45475[198, 354]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_005604__989.json90.0missing{\n "num_gpu": 99\n}missing
1772Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_222616__57640.038.80885[198, 267]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_222616__576.json95.0missing{\n "num_gpu": 99\n}missing
1773Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231213_235752__41200.023.32070[280, 587]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235752__412.json25.0missingmissingmissing
1774Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_005335__72700.080.11620[290, 373]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_005335__727.json25.0missing{\n "num_gpu": 99\n}missing
1775Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_005423__53430.047.51034[290, 313]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_005423__534.json85.0missing{\n "num_gpu": 99\n}missing
1776Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231226_222537__37100.072.93590[290, 337]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222537__371.json0.0missing{\n "num_gpu": 99\n}missing
1777Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231213_235940__17600.033.83780[11, 857]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235940__176.json0.0missingmissingmissing
1778Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_010419__47200.090.16150[472, 587]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010419__472.json50.0missing{\n "num_gpu": 99\n}missing
1779Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_010516__90100.056.93080[472, 349]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010516__901.json50.0missing{\n "num_gpu": 99\n}missing
1780Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231226_222913__25500.058.40820[472, 362]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222913__255.json50.0missing{\n "num_gpu": 99\n}missing
1781Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTfalsefalse520231213_235906__52000.015.49020[455, 303]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_235906__520.json0.0missingmissingmissing
1782Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_010143__77300.076.34690[470, 489]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_010143__773.json25.0missing{\n "num_gpu": 99\n}missing
1783Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_010249__53500.065.97570[470, 415]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_010249__535.json25.0missing{\n "num_gpu": 99\n}missing
1784Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_222814__70700.048.17110[470, 287]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_222814__707.json50.0missing{\n "num_gpu": 99\n}missing
1785Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231225_021310__93730.03.977432[83, 61]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_021310__937.json100.0missing{\n "num_gpu": 99\n}missing
1786Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruefalse320231225_021323__59400.013.02990[83, 233]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_021323__594.json25.0missing{\n "num_gpu": 99\n}missing
1787Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231225_161936__19430.011.08982[83, 198]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_161936__194.json100.0missing{\n "num_gpu": 99\n}missing
1788Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231225_161948__23700.012.25072[83, 219]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_161948__237.json75.0missing{\n "num_gpu": 99\n}missing
1789Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231226_230442__77030.012.69762[83, 228]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_230442__770.json100.0missing{\n "num_gpu": 99\n}missing
1790Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231225_021301__44530.09.0432[122, 153]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_021301__445.json100.0missing{\n "num_gpu": 99\n}missing
1791Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse320231225_021306__47700.04.122510[122, 59]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_021306__477.json0.0missing{\n "num_gpu": 99\n}missing
1792Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231225_161920__78430.04.307762[122, 62]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_161920__784.json100.0missing{\n "num_gpu": 99\n}missing
1793Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231225_161924__19230.04.172532[122, 60]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_161924__192.json100.0missing{\n "num_gpu": 99\n}missing
1794Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231226_230429__47930.04.35222[122, 64]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_230429__479.json100.0missing{\n "num_gpu": 99\n}missing
1795Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231225_021248__31030.015.00762[205, 62]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021248__310.json100.0missing{\n "num_gpu": 99\n}missing
1796Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231225_021252__78230.04.832152[205, 58]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021252__782.json100.0missing{\n "num_gpu": 99\n}missing
1797Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse320231225_161902__54800.014.43420[205, 56]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161902__548.json0.0missing{\n "num_gpu": 99\n}missing
1798Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231225_161916__16130.013.24142[205, 215]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161916__161.json100.0missing{\n "num_gpu": 99\n}missing
1799Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231226_230424__57630.026.74642[205, 293]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230424__576.json100.0missing{\n "num_gpu": 99\n}missing
1800Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse320231225_021501__19200.014.38370[387, 202]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021501__192.json25.0missing{\n "num_gpu": 99\n}missing
1801Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue320231225_021524__64730.022.25662[387, 342]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021524__647.json100.0missing{\n "num_gpu": 99\n}missing
1802Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse320231225_162059__81000.022.21640[387, 343]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162059__810.json25.0missing{\n "num_gpu": 99\n}missing
1803Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse320231225_162106__44700.06.761830[387, 64]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162106__447.json0.0missing{\n "num_gpu": 99\n}missing
1804Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse320231226_230520__50900.032.53270[387, 522]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230520__509.json25.0missing{\n "num_gpu": 99\n}missing
1805Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_021415__20000.026.58512[384, 422]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_021415__200.json75.0missing{\n "num_gpu": 99\n}missing
1806Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruefalse320231225_021447__72000.032.02820[384, 516]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_021447__720.json25.0missing{\n "num_gpu": 99\n}missing
1807Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_162016__94330.016.02092[384, 231]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_162016__943.json100.0missing{\n "num_gpu": 99\n}missing
1808Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_162037__63030.020.86272[384, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_162037__630.json100.0missing{\n "num_gpu": 99\n}missing
1809Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTfalsefalse320231226_230448__78800.05.88580[384, 52]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_230448__788.json0.0missing{\n "num_gpu": 99\n}missing
1810Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231214_002022__83300.06.405110[75, 188]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_002022__833.json0.0missingmissingmissing
1811Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_021600__53000.015.34840[57, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_021600__530.json0.0missing{\n "num_gpu": 99\n}missing
1812Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_021606__95700.05.899970[57, 103]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_021606__957.json0.0missing{\n "num_gpu": 99\n}missing
1813Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_162127__95400.00.7497270[57, 4]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_162127__954.json0.0missing{\n "num_gpu": 99\n}missing
1814Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_162132__48300.04.862420[57, 84]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_162132__483.json0.0missing{\n "num_gpu": 99\n}missing
1815Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231214_002015__29800.06.458960[105, 179]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_002015__298.json0.0missingmissingmissing
1816Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_021544__29000.07.13570[59, 127]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_021544__290.json0.0missing{\n "num_gpu": 99\n}missing
1817Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_021545__82700.00.760090[59, 4]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_021545__827.json0.0missing{\n "num_gpu": 99\n}missing
1818Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_162124__43300.05.806280[59, 102]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_162124__433.json0.0missing{\n "num_gpu": 99\n}missing
1819Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_162126__24600.02.652320[59, 41]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_162126__246.json0.0missing{\n "num_gpu": 99\n}missing
1820Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue320231214_002008__78500.015.98132[187, 431]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002008__785.json75.0missingmissingmissing
1821Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_021535__59000.011.53480[80, 15]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021535__590.json0.0missing{\n "num_gpu": 99\n}missing
1822Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_021537__85300.01.688720[80, 17]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021537__853.json0.0missing{\n "num_gpu": 99\n}missing
1823Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_162117__85100.010.85470[80, 1]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162117__851.json0.0missing{\n "num_gpu": 99\n}missing
1824Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_162118__55900.00.8653570[80, 1]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162118__559.json0.0missing{\n "num_gpu": 99\n}missing
1825Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue320231214_002110__47900.017.92572[11, 489]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_002110__479.json75.0missingmissingmissing
1826Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse320231225_021812__76000.07.404010[76, 127]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021812__760.json0.0missing{\n "num_gpu": 99\n}missing
1827Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse320231225_162202__71000.01.535710[76, 14]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162202__710.json0.0missing{\n "num_gpu": 99\n}missing
1828Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse320231225_162207__91000.04.518480[76, 72]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162207__910.json0.0missing{\n "num_gpu": 99\n}missing
1829Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTtruefalse320231214_002052__88600.022.9950[376, 538]0.4.021.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_002052__886.json25.0missingmissingmissing
1830Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231225_021804__88300.01.68090[73, 17]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_021804__883.json0.0missing{\n "num_gpu": 99\n}missing
1831Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231225_162159__22600.01.681570[73, 17]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_162159__226.json0.0missing{\n "num_gpu": 99\n}missing
1832Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231225_162201__15700.01.510640[73, 14]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_162201__157.json0.0missing{\n "num_gpu": 99\n}missing
1833Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_023255__42030.028.81662[74, 168]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_023255__420.json100.0missing{\n "num_gpu": 99\n}missing
1834Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_023321__42930.025.88712[74, 150]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_023321__429.json100.0missing{\n "num_gpu": 99\n}missing
1835Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_163646__27730.043.15552[74, 259]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_163646__277.json100.0missing{\n "num_gpu": 99\n}missing
1836Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_163728__51530.041.99052[74, 252]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_163728__515.json100.0missing{\n "num_gpu": 99\n}missing
1837Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231226_231325__77130.032.88152[74, 194]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_231325__771.json100.0missing{\n "num_gpu": 99\n}missing
1838Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_023131__88630.042.6512[115, 248]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023131__886.json100.0missing{\n "num_gpu": 99\n}missing
1839Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_023226__41900.053.65382[115, 316]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023226__419.json75.0missing{\n "num_gpu": 99\n}missing
1840Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_163531__76230.031.36562[115, 179]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_163531__762.json100.0missing{\n "num_gpu": 99\n}missing
1841Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse320231225_163602__80400.030.82550[115, 176]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_163602__804.json25.0missing{\n "num_gpu": 99\n}missing
1842Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231226_231252__16430.042.04342[115, 246]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231252__164.json100.0missing{\n "num_gpu": 99\n}missing
1843Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_023029__83530.069.0782[197, 222]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023029__835.json100.0missing{\n "num_gpu": 99\n}missing
1844Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_023048__37830.019.10212[197, 87]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023048__378.json100.0missing{\n "num_gpu": 99\n}missing
1845Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_163430__21200.048.27112[197, 105]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_163430__212.json75.0missing{\n "num_gpu": 99\n}missing
1846Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_163459__34530.028.9392[197, 149]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_163459__345.json100.0missing{\n "num_gpu": 99\n}missing
1847Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231210__87300.075.2132[197, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231210__873.json75.0missing{\n "num_gpu": 99\n}missing
1848Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_023705__52400.037.56562[403, 169]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_023705__524.json75.0missing{\n "num_gpu": 99\n}missing
1849Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_023735__21930.029.80912[403, 122]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_023735__219.json100.0missing{\n "num_gpu": 99\n}missing
1850Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164114__20030.040.83682[403, 190]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164114__200.json100.0missing{\n "num_gpu": 99\n}missing
1851Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164135__40430.020.92232[403, 68]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164135__404.json100.0missing{\n "num_gpu": 99\n}missing
1852Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231226_231439__30330.029.53772[403, 121]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231439__303.json100.0missing{\n "num_gpu": 99\n}missing
1853Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023550__70430.051.12492[401, 250]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023550__704.json100.0missing{\n "num_gpu": 99\n}missing
1854Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023627__21100.035.46692[401, 156]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023627__211.json75.0missing{\n "num_gpu": 99\n}missing
1855Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_163924__16100.043.122[401, 204]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_163924__161.json75.0missing{\n "num_gpu": 99\n}missing
1856Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164032__14330.068.55562[401, 357]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164032__143.json100.0missing{\n "num_gpu": 99\n}missing
1857Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231226_231409__52030.043.79222[401, 208]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231409__520.json100.0missing{\n "num_gpu": 99\n}missing
1858Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse320231226_232017__63200.07.325640[76, 282]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_232017__632.json25.0missing{\n "num_gpu": 99\n}missing
1859Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue320231227_110234__48900.07.340882[76, 282]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_110234__489.json75.0missing{\n "num_gpu": 99\n}missing
1860Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse320231227_110241__21700.06.553510[76, 251]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_110241__217.json25.0missing{\n "num_gpu": 99\n}missing
1861Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse320231227_110248__92500.06.689850[76, 256]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_110248__925.json25.0missing{\n "num_gpu": 99\n}missing
1862Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse320231226_232010__60000.01.272910[113, 38]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_232010__600.json0.0missing{\n "num_gpu": 99\n}missing
1863Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse320231227_110215__99100.01.832260[113, 61]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_110215__991.json0.0missing{\n "num_gpu": 99\n}missing
1864Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse320231227_110220__34200.05.3890[113, 201]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_110220__342.json25.0missing{\n "num_gpu": 99\n}missing
1865Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse320231227_110227__12100.06.305940[113, 237]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_110227__121.json0.0missing{\n "num_gpu": 99\n}missing
1866Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231226_232008__22600.08.677660[193, 184]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232008__226.json0.0missing{\n "num_gpu": 99\n}missing
1867Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231227_110207__57400.07.821990[193, 146]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110207__574.json0.0missing{\n "num_gpu": 99\n}missing
1868Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse320231227_110210__48500.02.817420[193, 87]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110210__485.json25.0missing{\n "num_gpu": 99\n}missing
1869Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse320231227_110213__81900.03.202430[193, 102]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110213__819.json25.0missing{\n "num_gpu": 99\n}missing
1870Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse320231226_232035__96300.09.024360[365, 293]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232035__963.json25.0missing{\n "num_gpu": 99\n}missing
1871Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse320231227_110319__28800.06.022110[365, 183]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110319__288.json25.0missing{\n "num_gpu": 99\n}missing
1872Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231227_110327__58900.08.331320[365, 268]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110327__589.json0.0missing{\n "num_gpu": 99\n}missing
1873Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231227_110335__36500.08.105140[365, 260]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110335__365.json0.0missing{\n "num_gpu": 99\n}missing
1874Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse320231226_232026__38600.09.381190[362, 306]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_232026__386.json25.0missing{\n "num_gpu": 99\n}missing
1875Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse320231227_110300__37400.012.24850[362, 407]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_110300__374.json0.0missing{\n "num_gpu": 99\n}missing
1876Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse320231227_110307__64200.06.865670[362, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_110307__642.json25.0missing{\n "num_gpu": 99\n}missing
1877Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse320231227_110313__98100.05.935430[362, 180]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_110313__981.json0.0missing{\n "num_gpu": 99\n}missing
1878Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTtruetrue320231225_015934__63000.06.596752[75, 194]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_015934__630.json75.0missing{\n "num_gpu": 99\n}missing
1879Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTfalsefalse320231225_015941__41700.07.122350[1, 226]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_015941__417.json0.0missing{\n "num_gpu": 99\n}missing
1880Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTtruefalse320231225_160503__19100.08.525430[75, 255]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_160503__191.json25.0missing{\n "num_gpu": 99\n}missing
1881Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTtruefalse320231225_160510__34400.06.887980[1, 221]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_160510__344.json25.0missing{\n "num_gpu": 99\n}missing
1882Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTfalsefalse320231226_225753__71000.08.339190[75, 252]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231226_225753__710.json0.0missing{\n "num_gpu": 99\n}missing
1883Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_015923__86700.09.055260[105, 259]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_015923__867.json0.0missing{\n "num_gpu": 99\n}missing
1884Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_015927__91300.04.807970[1, 153]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_015927__913.json0.0missing{\n "num_gpu": 99\n}missing
1885Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_160449__66800.06.321910[105, 177]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_160449__668.json0.0missing{\n "num_gpu": 99\n}missing
1886Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTtruefalse320231225_160455__44900.05.415660[1, 173]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_160455__449.json25.0missing{\n "num_gpu": 99\n}missing
1887Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231226_225744__74300.06.663440[105, 190]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_225744__743.json0.0missing{\n "num_gpu": 99\n}missing
1888Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_015905__28600.013.01680[205, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015905__286.json0.0missing{\n "num_gpu": 99\n}missing
1889Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_015914__42700.08.770960[1, 266]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015914__427.json0.0missing{\n "num_gpu": 99\n}missing
1890Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_160437__48900.013.16350[205, 201]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160437__489.json0.0missing{\n "num_gpu": 99\n}missing
1891Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_160443__94900.06.143490[1, 190]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160443__949.json0.0missing{\n "num_gpu": 99\n}missing
1892Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231226_225738__95300.014.92320[205, 270]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225738__953.json0.0missing{\n "num_gpu": 99\n}missing
1893Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTtruefalse320231225_020048__51600.013.90860[11, 384]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020048__516.json25.0missing{\n "num_gpu": 99\n}missing
1894Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTtruefalse320231225_020101__17200.012.66020[1, 356]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020101__172.json25.0missing{\n "num_gpu": 99\n}missing
1895Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTfalsefalse320231225_160628__75400.015.44150[11, 426]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160628__754.json0.0missing{\n "num_gpu": 99\n}missing
1896Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTfalsefalse320231225_160644__46500.016.16720[1, 451]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160644__465.json0.0missing{\n "num_gpu": 99\n}missing
1897Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTtruefalse320231226_225837__89900.015.87510[11, 442]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225837__899.json25.0missing{\n "num_gpu": 99\n}missing
1898Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231225_020021__94600.022.23840[376, 518]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_020021__946.json0.0missing{\n "num_gpu": 99\n}missing
1899Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231225_020034__75000.013.19680[1, 371]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_020034__750.json0.0missing{\n "num_gpu": 99\n}missing
1900Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231225_160550__82500.023.07340[376, 542]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_160550__825.json0.0missing{\n "num_gpu": 99\n}missing
1901Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTtruefalse320231225_160612__31400.022.1250[1, 603]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_160612__314.json25.0missing{\n "num_gpu": 99\n}missing
1902Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231226_225821__86300.028.83160[376, 691]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_225821__863.json0.0missing{\n "num_gpu": 99\n}missing
1903Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231225_021852__90730.04.726712[75, 148]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_021852__907.json100.0missing{\n "num_gpu": 99\n}missing
1904Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231225_021857__83330.05.116092[75, 161]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_021857__833.json100.0missing{\n "num_gpu": 99\n}missing
1905Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231225_162250__52830.09.058022[75, 297]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_162250__528.json100.0missing{\n "num_gpu": 99\n}missing
1906Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTfalsefalse320231225_162301__22000.010.40380[75, 342]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_162301__220.json0.0missing{\n "num_gpu": 99\n}missing
1907Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231226_230546__40430.07.477492[75, 242]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231226_230546__404.json100.0missing{\n "num_gpu": 99\n}missing
1908Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231225_021840__35230.05.101722[115, 155]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_021840__352.json100.0missing{\n "num_gpu": 99\n}missing
1909Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231225_021847__82800.07.183372[115, 225]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_021847__828.json75.0missing{\n "num_gpu": 99\n}missing
1910Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruefalse320231225_162235__82200.07.17220[115, 228]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_162235__822.json25.0missing{\n "num_gpu": 99\n}missing
1911Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231225_162241__34630.06.238692[115, 195]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_162241__346.json100.0missing{\n "num_gpu": 99\n}missing
1912Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231226_230539__75830.07.014792[115, 221]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_230539__758.json100.0missing{\n "num_gpu": 99\n}missing
1913Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_021823__84630.010.93162[197, 135]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021823__846.json100.0missing{\n "num_gpu": 99\n}missing
1914Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_021835__63730.011.12912[197, 338]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021835__637.json100.0missing{\n "num_gpu": 99\n}missing
1915Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_162219__13230.012.22752[197, 180]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162219__132.json100.0missing{\n "num_gpu": 99\n}missing
1916Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_162227__60130.08.260062[197, 247]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162227__601.json100.0missing{\n "num_gpu": 99\n}missing
1917Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231226_230531__30730.011.27262[197, 155]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230531__307.json100.0missing{\n "num_gpu": 99\n}missing
1918Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_021939__61530.013.03682[379, 368]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021939__615.json100.0missing{\n "num_gpu": 99\n}missing
1919Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_021943__48430.03.584932[379, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021943__484.json100.0missing{\n "num_gpu": 99\n}missing
1920Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_162337__15230.06.628542[379, 166]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162337__152.json100.0missing{\n "num_gpu": 99\n}missing
1921Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_162344__97330.07.315492[379, 188]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162344__973.json100.0missing{\n "num_gpu": 99\n}missing
1922Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruefalse320231226_230604__31000.010.55810[379, 291]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230604__310.json25.0missing{\n "num_gpu": 99\n}missing
1923Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_021918__92030.09.917512[376, 270]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_021918__920.json100.0missing{\n "num_gpu": 99\n}missing
1924Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_021926__47030.07.66062[376, 198]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_021926__470.json100.0missing{\n "num_gpu": 99\n}missing
1925Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_162323__49430.09.028642[376, 244]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_162323__494.json100.0missing{\n "num_gpu": 99\n}missing
1926Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruefalse320231225_162330__27400.07.222730[376, 185]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_162330__274.json25.0missing{\n "num_gpu": 99\n}missing
1927Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231226_230554__71730.07.437472[376, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_230554__717.json100.0missing{\n "num_gpu": 99\n}missing
1928Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue320231227_175906__96730.011.69842[75, 225]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175906__967.json100.0missing{\n "num_gpu": 99\n}missing
1929Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue320231227_175916__26030.010.08512[75, 193]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175916__260.json100.0missing{\n "num_gpu": 99\n}missing
1930Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue320231227_175925__72730.08.529542[75, 162]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175925__727.json100.0missing{\n "num_gpu": 99\n}missing
1931Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse320231227_175830__75200.013.64560[115, 259]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175830__752.json25.0missing{\n "num_gpu": 99\n}missing
1932Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue320231227_175840__62330.010.25062[115, 192]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175840__623.json100.0missing{\n "num_gpu": 99\n}missing
1933Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue320231227_175854__36930.013.71442[115, 261]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175854__369.json100.0missing{\n "num_gpu": 99\n}missing
1934Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue320231227_175753__83430.015.69182[197, 288]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175753__834.json100.0missing{\n "num_gpu": 99\n}missing
1935Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse320231227_175804__67200.010.70050[197, 190]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175804__672.json25.0missing{\n "num_gpu": 99\n}missing
1936Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue320231227_175816__13130.012.53442[197, 226]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175816__131.json100.0missing{\n "num_gpu": 99\n}missing
1937Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue320231227_180021__40530.013.62142[379, 227]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180021__405.json100.0missing{\n "num_gpu": 99\n}missing
1938Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue320231227_180034__89830.012.79452[379, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180034__898.json100.0missing{\n "num_gpu": 99\n}missing
1939Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue320231227_180052__11730.017.31432[379, 298]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180052__117.json100.0missing{\n "num_gpu": 99\n}missing
1940Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue320231227_175941__48930.016.42352[376, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175941__489.json100.0missing{\n "num_gpu": 99\n}missing
1941Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue320231227_175958__55130.017.00072[376, 292]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175958__551.json100.0missing{\n "num_gpu": 99\n}missing
1942Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue320231227_180008__31130.09.380312[376, 145]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180008__311.json100.0missing{\n "num_gpu": 99\n}missing
1943Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse320231225_024039__56800.03.194170[71, 71]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_024039__568.json0.0missing{\n "num_gpu": 99\n}missing
1944Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_024044__85300.04.870362[71, 115]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_024044__853.json75.0missing{\n "num_gpu": 99\n}missing
1945Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse320231225_164517__98500.02.540550[71, 54]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_164517__985.json25.0missing{\n "num_gpu": 99\n}missing
1946Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_164521__54900.03.754512[71, 86]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_164521__549.json75.0missing{\n "num_gpu": 99\n}missing
1947Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse320231226_231607__84500.03.882250[71, 89]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_231607__845.json25.0missing{\n "num_gpu": 99\n}missing
1948Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_024032__19800.02.536632[113, 49]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024032__198.json75.0missing{\n "num_gpu": 99\n}missing
1949Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse320231225_024035__90300.03.10980[113, 64]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024035__903.json25.0missing{\n "num_gpu": 99\n}missing
1950Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164512__43700.02.504482[113, 48]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164512__437.json75.0missing{\n "num_gpu": 99\n}missing
1951Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164514__76700.02.532642[113, 49]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164514__767.json75.0missing{\n "num_gpu": 99\n}missing
1952Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231226_231603__45400.02.956720[113, 60]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231603__454.json0.0missing{\n "num_gpu": 99\n}missing
1953Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231225_024025__45800.010.21960[194, 86]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024025__458.json0.0missing{\n "num_gpu": 99\n}missing
1954Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_024030__22400.04.568920[194, 89]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024030__224.json25.0missing{\n "num_gpu": 99\n}missing
1955Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_164502__75900.011.09540[194, 115]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164502__759.json25.0missing{\n "num_gpu": 99\n}missing
1956Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164509__41600.07.218172[194, 158]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164509__416.json75.0missing{\n "num_gpu": 99\n}missing
1957Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231600__85000.013.74072[194, 188]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231600__850.json75.0missing{\n "num_gpu": 99\n}missing
1958Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_024136__40200.016.29470[380, 360]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024136__402.json25.0missing{\n "num_gpu": 99\n}missing
1959Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_024150__15500.013.95090[380, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024150__155.json25.0missing{\n "num_gpu": 99\n}missing
1960Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164549__89800.07.218152[380, 134]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164549__898.json75.0missing{\n "num_gpu": 99\n}missing
1961Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_164555__76400.06.321190[380, 111]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164555__764.json25.0missing{\n "num_gpu": 99\n}missing
1962Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231226_231635__42800.012.27220[380, 260]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231635__428.json0.0missing{\n "num_gpu": 99\n}missing
1963Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse320231225_024108__77800.015.1880[378, 332]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024108__778.json25.0missing{\n "num_gpu": 99\n}missing
1964Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_024119__68600.011.32012[378, 236]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024119__686.json75.0missing{\n "num_gpu": 99\n}missing
1965Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164535__65800.07.927942[378, 152]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164535__658.json75.0missing{\n "num_gpu": 99\n}missing
1966Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320231225_164542__10400.06.997070[378, 128]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164542__104.json0.0missing{\n "num_gpu": 99\n}missing
1967Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320231226_231623__13000.015.61730[378, 343]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231623__130.json0.0missing{\n "num_gpu": 99\n}missing
1968Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231104__98230.09.116962[70, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231104__982.json100.0missing{\n "num_gpu": 99\n}missing
1969Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231112__81530.07.563392[70, 236]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231112__815.json100.0missing{\n "num_gpu": 99\n}missing
1970Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse320231227_231119__26900.06.903750[70, 213]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231119__269.json25.0missing{\n "num_gpu": 99\n}missing
1971Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231128__69230.09.01822[70, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231128__692.json100.0missing{\n "num_gpu": 99\n}missing
1972Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231133__26330.05.381132[70, 165]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231133__263.json100.0missing{\n "num_gpu": 99\n}missing
1973Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231045__99300.03.047652[112, 82]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231045__993.json75.0missing{\n "num_gpu": 99\n}missing
1974Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231047__41730.02.543022[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231047__417.json100.0missing{\n "num_gpu": 99\n}missing
1975Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231050__92730.02.534812[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231050__927.json100.0missing{\n "num_gpu": 99\n}missing
1976Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231053__14530.02.556162[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231053__145.json100.0missing{\n "num_gpu": 99\n}missing
1977Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231055__77730.02.527862[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231055__777.json100.0missing{\n "num_gpu": 99\n}missing
1978Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse320231227_231015__98700.05.657020[193, 126]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231015__987.json25.0missing{\n "num_gpu": 99\n}missing
1979Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231021__28200.06.152332[193, 169]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231021__282.json75.0missing{\n "num_gpu": 99\n}missing
1980Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231029__31900.08.553972[193, 247]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231029__319.json75.0missing{\n "num_gpu": 99\n}missing
1981Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231039__85800.09.323942[193, 271]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231039__858.json75.0missing{\n "num_gpu": 99\n}missing
1982Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231042__71500.02.88112[193, 62]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231042__715.json75.0missing{\n "num_gpu": 99\n}missing
1983Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse320231227_231248__18600.011.00620[379, 294]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231248__186.json25.0missing{\n "num_gpu": 99\n}missing
1984Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue320231227_231258__28400.010.08412[379, 265]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231258__284.json75.0missing{\n "num_gpu": 99\n}missing
1985Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue320231227_231311__97600.013.01212[379, 356]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231311__976.json75.0missing{\n "num_gpu": 99\n}missing
1986Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse320231227_231320__92400.08.144040[379, 205]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231320__924.json25.0missing{\n "num_gpu": 99\n}missing
1987Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse320231227_231330__93800.010.55170[379, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231330__938.json25.0missing{\n "num_gpu": 99\n}missing
1988Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue320231227_231145__35000.011.79382[377, 318]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231145__350.json75.0missing{\n "num_gpu": 99\n}missing
1989Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse320231227_231155__57300.010.15250[377, 268]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231155__573.json25.0missing{\n "num_gpu": 99\n}missing
1990Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse320231227_231213__65100.017.26890[377, 486]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231213__651.json25.0missing{\n "num_gpu": 99\n}missing
1991Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse320231227_231224__86700.011.66530[377, 314]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231224__867.json25.0missing{\n "num_gpu": 99\n}missing
1992Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse320231227_231237__82300.012.76930[377, 349]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231237__823.json25.0missing{\n "num_gpu": 99\n}missing
1993Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231439__38700.012.66180[70, 316]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231439__387.json25.0missing{\n "num_gpu": 99\n}missing
1994Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231450__55800.010.32460[70, 256]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231450__558.json25.0missing{\n "num_gpu": 99\n}missing
1995Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231458__59100.08.385270[70, 206]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231458__591.json25.0missing{\n "num_gpu": 99\n}missing
1996Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231505__16600.07.340280[70, 179]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231505__166.json25.0missing{\n "num_gpu": 99\n}missing
1997Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231518__39500.012.07910[70, 301]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231518__395.json25.0missing{\n "num_gpu": 99\n}missing
1998Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231414__29730.03.163882[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231414__297.json100.0missing{\n "num_gpu": 99\n}missing
1999Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231417__97130.03.155852[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231417__971.json100.0missing{\n "num_gpu": 99\n}missing
2000Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231420__72130.03.167752[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231420__721.json100.0missing{\n "num_gpu": 99\n}missing
2001Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231423__30730.03.155992[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231423__307.json100.0missing{\n "num_gpu": 99\n}missing
2002Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231427__15030.03.168342[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231427__150.json100.0missing{\n "num_gpu": 99\n}missing
2003Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231227_231336__26100.05.868240[193, 101]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231336__261.json25.0missing{\n "num_gpu": 99\n}missing
2004Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231341__35630.05.044882[193, 101]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231341__356.json100.0missing{\n "num_gpu": 99\n}missing
2005Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231352__84930.010.95192[193, 252]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231352__849.json100.0missing{\n "num_gpu": 99\n}missing
2006Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231227_231407__23400.015.14530[193, 358]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231407__234.json25.0missing{\n "num_gpu": 99\n}missing
2007Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231411__51300.03.386262[193, 58]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231411__513.json75.0missing{\n "num_gpu": 99\n}missing
2008Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_231648__29800.09.389322[379, 187]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231648__298.json75.0missing{\n "num_gpu": 99\n}missing
2009Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_231659__56500.010.79490[379, 222]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231659__565.json25.0missing{\n "num_gpu": 99\n}missing
2010Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_231712__98800.013.17822[379, 281]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231712__988.json75.0missing{\n "num_gpu": 99\n}missing
2011Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_231725__87300.012.68660[379, 269]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231725__873.json25.0missing{\n "num_gpu": 99\n}missing
2012Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_231737__62600.012.81110[379, 272]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231737__626.json25.0missing{\n "num_gpu": 99\n}missing
2013Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231532__26400.014.4650[377, 313]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231532__264.json25.0missing{\n "num_gpu": 99\n}missing
2014Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231545__43100.013.4150[377, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231545__431.json25.0missing{\n "num_gpu": 99\n}missing
2015Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231605__81900.019.55520[377, 437]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231605__819.json25.0missing{\n "num_gpu": 99\n}missing
2016Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_231624__51730.018.79952[377, 419]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231624__517.json100.0missing{\n "num_gpu": 99\n}missing
2017Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231638__21200.014.63010[377, 317]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231638__212.json25.0missing{\n "num_gpu": 99\n}missing
2018Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse320231226_121005__63300.014.23110[70, 256]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121005__633.json25.0missing{\n "num_gpu": 99\n}missing
2019Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse320231226_121017__84300.011.94230[70, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121017__843.json25.0missing{\n "num_gpu": 99\n}missing
2020Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse320231226_231924__95100.019.54350[70, 359]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_231924__951.json25.0missing{\n "num_gpu": 99\n}missing
2021Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue320231226_120947__27730.04.289542[112, 66]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120947__277.json100.0missing{\n "num_gpu": 99\n}missing
2022Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue320231226_120951__99030.04.243732[112, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120951__990.json100.0missing{\n "num_gpu": 99\n}missing
2023Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue320231226_231904__16430.04.185622[112, 66]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_231904__164.json100.0missing{\n "num_gpu": 99\n}missing
2024Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue320231226_120936__53430.04.337172[193, 57]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120936__534.json100.0missing{\n "num_gpu": 99\n}missing
2025Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue320231226_120942__95930.06.515272[193, 97]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120942__959.json100.0missing{\n "num_gpu": 99\n}missing
2026Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse320231226_231900__84400.021.74170[193, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231900__844.json25.0missing{\n "num_gpu": 99\n}missing
2027Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse320231226_121137__42100.015.85340[379, 248]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121137__421.json25.0missing{\n "num_gpu": 99\n}missing
2028Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse320231226_121156__39500.019.51190[379, 312]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121156__395.json25.0missing{\n "num_gpu": 99\n}missing
2029Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue320231226_232000__94700.015.71922[379, 252]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232000__947.json75.0missing{\n "num_gpu": 99\n}missing
2030Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse320231226_121102__19500.017.74230[377, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121102__195.json25.0missing{\n "num_gpu": 99\n}missing
2031Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue320231226_121120__47000.017.99312[377, 285]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121120__470.json75.0missing{\n "num_gpu": 99\n}missing
2032Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse320231226_231944__27700.019.94420[377, 329]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_231944__277.json25.0missing{\n "num_gpu": 99\n}missing
2033Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse320231227_110712__57400.044.56990[78, 261]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_110712__574.json25.0missing{\n "num_gpu": 99\n}missing
2034Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue320231227_110744__17230.031.8212[78, 183]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_110744__172.json100.0missing{\n "num_gpu": 99\n}missing
2035Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse320231227_110829__96600.044.89160[78, 263]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_110829__966.json25.0missing{\n "num_gpu": 99\n}missing
2036Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse320231227_144830__69200.053.98220[78, 317]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_144830__692.json25.0missing{\n "num_gpu": 99\n}missing
2037Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse320231227_144902__36000.031.28320[78, 179]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_144902__360.json25.0missing{\n "num_gpu": 99\n}missing
2038Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_110601__70030.013.8572[117, 67]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_110601__700.json100.0missing{\n "num_gpu": 99\n}missing
2039Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_110615__44930.013.70582[117, 66]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_110615__449.json100.0missing{\n "num_gpu": 99\n}missing
2040Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231227_110627__47200.012.41080[117, 58]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_110627__472.json0.0missing{\n "num_gpu": 99\n}missing
2041Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_144721__98430.020.43952[117, 107]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_144721__984.json100.0missing{\n "num_gpu": 99\n}missing
2042Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_144736__22730.014.74582[117, 72]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_144736__227.json100.0missing{\n "num_gpu": 99\n}missing
2043Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231227_110434__99800.058.6050[197, 294]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110434__998.json25.0missing{\n "num_gpu": 99\n}missing
2044Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231227_110507__54100.033.2060[197, 171]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110507__541.json25.0missing{\n "num_gpu": 99\n}missing
2045Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231227_110547__98200.040.30860[197, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110547__982.json0.0missing{\n "num_gpu": 99\n}missing
2046Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_144552__78130.035.67672[197, 185]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_144552__781.json100.0missing{\n "num_gpu": 99\n}missing
2047Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_144701__96930.069.10442[197, 385]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_144701__969.json100.0missing{\n "num_gpu": 99\n}missing
2048Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_111137__17500.055.09540[391, 268]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111137__175.json25.0missing{\n "num_gpu": 99\n}missing
2049Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_111214__13800.036.70470[391, 159]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111214__138.json25.0missing{\n "num_gpu": 99\n}missing
2050Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_111302__44500.048.66150[391, 230]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111302__445.json25.0missing{\n "num_gpu": 99\n}missing
2051Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_145152__11530.061.17572[391, 302]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145152__115.json100.0missing{\n "num_gpu": 99\n}missing
2052Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_145237__81130.044.32372[391, 203]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145237__811.json100.0missing{\n "num_gpu": 99\n}missing
2053Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_110900__60830.031.17232[389, 126]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_110900__608.json100.0missing{\n "num_gpu": 99\n}missing
2054Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_110943__91100.043.41570[389, 199]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_110943__911.json25.0missing{\n "num_gpu": 99\n}missing
2055Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_111042__42000.058.29720[389, 287]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_111042__420.json50.0missing{\n "num_gpu": 99\n}missing
2056Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse320231227_144946__13600.044.82230[389, 206]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_144946__136.json0.0missing{\n "num_gpu": 99\n}missing
2057Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_145051__59230.064.38332[389, 321]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_145051__592.json100.0missing{\n "num_gpu": 99\n}missing
2058Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse320231225_024232__88800.08.327030[79, 205]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_024232__888.json25.0missing{\n "num_gpu": 99\n}missing
2059Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_024239__64930.06.71522[79, 163]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_024239__649.json100.0missing{\n "num_gpu": 99\n}missing
2060Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_164638__30500.07.076382[79, 173]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_164638__305.json75.0missing{\n "num_gpu": 99\n}missing
2061Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_164646__25000.07.661052[79, 188]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_164646__250.json75.0missing{\n "num_gpu": 99\n}missing
2062Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse320231226_231707__19200.06.839550[79, 166]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_231707__192.json25.0missing{\n "num_gpu": 99\n}missing
2063Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_024220__52300.03.504932[121, 74]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024220__523.json75.0missing{\n "num_gpu": 99\n}missing
2064Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_024224__44400.03.507412[121, 74]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024224__444.json75.0missing{\n "num_gpu": 99\n}missing
2065Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164628__52430.03.159922[121, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164628__524.json100.0missing{\n "num_gpu": 99\n}missing
2066Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164631__17430.03.153532[121, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164631__174.json100.0missing{\n "num_gpu": 99\n}missing
2067Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231226_231700__23830.06.552952[121, 153]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231700__238.json100.0missing{\n "num_gpu": 99\n}missing
2068Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_024208__99600.018.48750[202, 283]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024208__996.json25.0missing{\n "num_gpu": 99\n}missing
2069Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231225_024217__29300.08.540660[202, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024217__293.json0.0missing{\n "num_gpu": 99\n}missing
2070Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164613__72230.017.88292[202, 264]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164613__722.json100.0missing{\n "num_gpu": 99\n}missing
2071Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164624__87800.010.772[202, 249]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164624__878.json75.0missing{\n "num_gpu": 99\n}missing
2072Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231653__74630.017.93492[202, 279]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231653__746.json100.0missing{\n "num_gpu": 99\n}missing
2073Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_024336__58200.012.50922[388, 262]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024336__582.json75.0missing{\n "num_gpu": 99\n}missing
2074Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_024348__64600.012.24422[388, 255]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024348__646.json75.0missing{\n "num_gpu": 99\n}missing
2075Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164736__81130.010.39242[388, 210]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164736__811.json100.0missing{\n "num_gpu": 99\n}missing
2076Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_164748__27800.011.56150[388, 239]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164748__278.json25.0missing{\n "num_gpu": 99\n}missing
2077Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231226_231730__43400.011.87480[388, 246]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231730__434.json25.0missing{\n "num_gpu": 99\n}missing
2078Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse320231225_024305__25800.09.878680[386, 196]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024305__258.json25.0missing{\n "num_gpu": 99\n}missing
2079Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse320231225_024323__96800.018.39920[386, 407]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024323__968.json25.0missing{\n "num_gpu": 99\n}missing
2080Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164715__23200.011.56932[386, 239]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164715__232.json75.0missing{\n "num_gpu": 99\n}missing
2081Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164726__88630.010.45772[386, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164726__886.json100.0missing{\n "num_gpu": 99\n}missing
2082Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse320231226_231718__28200.011.67930[386, 241]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231718__282.json25.0missing{\n "num_gpu": 99\n}missing
2083Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruefalse320231225_020201__96900.011.85590[77, 379]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_020201__969.json25.0missing{\n "num_gpu": 99\n}missing
2084Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruefalse320231225_020208__24400.06.092860[77, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_020208__244.json25.0missing{\n "num_gpu": 99\n}missing
2085Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231225_160738__78800.010.42230[77, 337]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_160738__788.json50.0missing{\n "num_gpu": 99\n}missing
2086Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231225_160746__61100.07.587972[77, 242]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_160746__611.json75.0missing{\n "num_gpu": 99\n}missing
2087Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231226_225903__19700.09.450562[77, 303]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_225903__197.json75.0missing{\n "num_gpu": 99\n}missing
2088Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse320231225_020140__96200.09.109630[119, 284]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_020140__962.json25.0missing{\n "num_gpu": 99\n}missing
2089Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue320231225_020149__73530.09.800192[119, 307]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_020149__735.json100.0missing{\n "num_gpu": 99\n}missing
2090Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue320231225_160721__52430.010.29452[119, 326]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_160721__524.json100.0missing{\n "num_gpu": 99\n}missing
2091Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse320231225_160728__81000.06.596480[119, 203]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_160728__810.json0.0missing{\n "num_gpu": 99\n}missing
2092Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue320231226_225854__26400.03.633722[119, 103]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_225854__264.json75.0missing{\n "num_gpu": 99\n}missing
2093Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse320231225_020115__95600.014.21580[200, 259]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020115__956.json25.0missing{\n "num_gpu": 99\n}missing
2094Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231225_020130__66230.014.94132[200, 454]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020130__662.json100.0missing{\n "num_gpu": 99\n}missing
2095Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231225_160700__63530.015.79632[200, 319]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160700__635.json100.0missing{\n "num_gpu": 99\n}missing
2096Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse320231225_160711__52100.010.42820[200, 313]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160711__521.json25.0missing{\n "num_gpu": 99\n}missing
2097Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231226_225850__25530.012.48742[200, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225850__255.json100.0missing{\n "num_gpu": 99\n}missing
2098Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231225_020245__42500.02.492090[386, 21]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020245__425.json0.0missing{\n "num_gpu": 99\n}missing
2099Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231225_020247__47000.02.368470[386, 17]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020247__470.json0.0missing{\n "num_gpu": 99\n}missing
2100Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue320231225_160834__63030.011.37832[386, 307]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160834__630.json100.0missing{\n "num_gpu": 99\n}missing
2101Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231225_160836__77000.02.648020[386, 26]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160836__770.json0.0missing{\n "num_gpu": 99\n}missing
2102Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231226_225916__98800.04.104950[386, 74]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225916__988.json0.0missing{\n "num_gpu": 99\n}missing
2103Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_020235__90500.010.42272[384, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_020235__905.json75.0missing{\n "num_gpu": 99\n}missing
2104Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_020242__90900.07.026352[384, 173]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_020242__909.json75.0missing{\n "num_gpu": 99\n}missing
2105Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_160811__85200.010.95442[384, 300]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_160811__852.json75.0missing{\n "num_gpu": 99\n}missing
2106Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_160822__85130.011.52972[384, 318]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_160822__851.json100.0missing{\n "num_gpu": 99\n}missing
2107Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231226_225912__64500.08.714862[384, 227]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_225912__645.json75.0missing{\n "num_gpu": 99\n}missing
2108Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruetrue320231225_022130__26530.07.390472[78, 126]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_022130__265.json100.0missing{\n "num_gpu": 99\n}missing
2109Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruefalse320231225_022140__45300.010.05710[78, 177]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_022140__453.json25.0missing{\n "num_gpu": 99\n}missing
2110Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruetrue320231225_162524__94800.05.519372[78, 91]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_162524__948.json75.0missing{\n "num_gpu": 99\n}missing
2111Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruefalse320231225_162534__51000.09.381360[78, 165]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_162534__510.json25.0missing{\n "num_gpu": 99\n}missing
2112Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruefalse320231226_230705__47600.012.79670[78, 229]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231226_230705__476.json25.0missing{\n "num_gpu": 99\n}missing
2113Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_022118__75500.04.166540[118, 60]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_022118__755.json0.0missing{\n "num_gpu": 99\n}missing
2114Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_022122__83900.04.176640[118, 60]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_022122__839.json0.0missing{\n "num_gpu": 99\n}missing
2115Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_162515__37800.03.94970[118, 56]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_162515__378.json0.0missing{\n "num_gpu": 99\n}missing
2116Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_162519__62600.04.148890[118, 60]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_162519__626.json0.0missing{\n "num_gpu": 99\n}missing
2117Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231226_230652__96400.04.163540[118, 60]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_230652__964.json0.0missing{\n "num_gpu": 99\n}missing
2118Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTtruetrue320231225_022109__50830.030.23812[200, 349]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022109__508.json100.0missing{\n "num_gpu": 99\n}missing
2119Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse320231225_022114__11400.05.186130[200, 64]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022114__114.json0.0missing{\n "num_gpu": 99\n}missing
2120Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTtruetrue320231225_162504__28200.020.53892[200, 178]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162504__282.json75.0missing{\n "num_gpu": 99\n}missing
2121Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse320231225_162511__76800.06.295660[200, 86]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162511__768.json0.0missing{\n "num_gpu": 99\n}missing
2122Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse320231226_230648__34600.015.69080[200, 94]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230648__346.json0.0missing{\n "num_gpu": 99\n}missing
2123Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_022251__56700.025.38480[382, 400]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022251__567.json0.0missing{\n "num_gpu": 99\n}missing
2124Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_022311__41400.019.69310[382, 300]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022311__414.json0.0missing{\n "num_gpu": 99\n}missing
2125Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_162631__15100.06.744750[382, 68]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162631__151.json0.0missing{\n "num_gpu": 99\n}missing
2126Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_162717__24800.045.89840[382, 751]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162717__248.json0.0missing{\n "num_gpu": 99\n}missing
2127Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTtruefalse320231226_230748__72600.028.78040[382, 460]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230748__726.json25.0missing{\n "num_gpu": 99\n}missing
2128Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTfalsefalse320231225_022210__24700.014.82250[379, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_022210__247.json0.0missing{\n "num_gpu": 99\n}missing
2129Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTtruefalse320231225_022226__52300.016.26490[379, 240]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_022226__523.json25.0missing{\n "num_gpu": 99\n}missing
2130Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTtruefalse320231225_162606__88700.013.70230[379, 195]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_162606__887.json25.0missing{\n "num_gpu": 99\n}missing
2131Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTtruetrue320231225_162624__59300.018.29222[379, 278]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_162624__593.json75.0missing{\n "num_gpu": 99\n}missing
2132Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTfalsefalse320231226_230719__90600.014.21390[379, 204]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_230719__906.json0.0missing{\n "num_gpu": 99\n}missing
2133Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_024422__58400.02.147330[70, 77]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_024422__584.json0.0missing{\n "num_gpu": 99\n}missing
2134Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_024446__71200.024.1440[70, 895]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_024446__712.json0.0missing{\n "num_gpu": 99\n}missing
2135Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_164834__84200.01.918420[70, 68]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_164834__842.json0.0missing{\n "num_gpu": 99\n}missing
2136Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_164850__58900.016.05430[70, 612]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_164850__589.json0.0missing{\n "num_gpu": 99\n}missing
2137Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231226_231758__70100.01.776320[70, 62]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_231758__701.json0.0missing{\n "num_gpu": 99\n}missing
2138Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_024419__79300.022.89010[107, 843]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_024419__793.json0.0missing{\n "num_gpu": 99\n}missing
2139Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_024420__33000.00.4325990[107, 4]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_024420__330.json0.0missing{\n "num_gpu": 99\n}missing
2140Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_164815__67500.019.90990[107, 741]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_164815__675.json0.0missing{\n "num_gpu": 99\n}missing
2141Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_164832__84000.017.1680[107, 645]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_164832__840.json0.0missing{\n "num_gpu": 99\n}missing
2142Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231226_231756__17200.020.56820[107, 761]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_231756__172.json0.0missing{\n "num_gpu": 99\n}missing
2143Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_024354__53000.05.96110[187, 69]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024354__530.json0.0missing{\n "num_gpu": 99\n}missing
2144Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_024356__87800.02.176680[187, 65]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024356__878.json0.0missing{\n "num_gpu": 99\n}missing
2145Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_164753__17000.04.775240[187, 22]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164753__170.json0.0missing{\n "num_gpu": 99\n}missing
2146Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_164755__65300.02.500780[187, 78]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164755__653.json0.0missing{\n "num_gpu": 99\n}missing
2147Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231226_231736__38300.05.386560[187, 55]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231736__383.json0.0missing{\n "num_gpu": 99\n}missing
2148Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_024526__54800.07.351150[359, 233]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024526__548.json0.0missing{\n "num_gpu": 99\n}missing
2149Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_024528__53500.01.302830[359, 4]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024528__535.json0.0missing{\n "num_gpu": 99\n}missing
2150Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_164953__84700.01.331730[359, 5]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164953__847.json0.0missing{\n "num_gpu": 99\n}missing
2151Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_164956__53900.02.656850[359, 57]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164956__539.json0.0missing{\n "num_gpu": 99\n}missing
2152Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231226_231838__64900.09.525330[359, 312]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231838__649.json0.0missing{\n "num_gpu": 99\n}missing
2153Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse320231225_024515__74700.05.330470[356, 158]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_024515__747.json25.0missing{\n "num_gpu": 99\n}missing
2154Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_024519__78700.04.257170[356, 118]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_024519__787.json0.0missing{\n "num_gpu": 99\n}missing
2155Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_164936__68900.01.225830[356, 1]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_164936__689.json0.0missing{\n "num_gpu": 99\n}missing
2156Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_164952__40800.015.60230[356, 530]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_164952__408.json0.0missing{\n "num_gpu": 99\n}missing
2157Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse320231226_231829__15700.030.81990[356, 1028]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_231829__157.json25.0missing{\n "num_gpu": 99\n}missing
2158Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_022542__39630.034.43572[86, 264]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_022542__396.json100.0missing{\n "num_gpu": 99\n}missing
2159Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_022603__90230.021.23432[86, 157]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_022603__902.json100.0missing{\n "num_gpu": 99\n}missing
2160Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_163015__45830.035.95512[86, 278]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_163015__458.json100.0missing{\n "num_gpu": 99\n}missing
2161Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_163047__57730.031.06512[86, 238]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_163047__577.json100.0missing{\n "num_gpu": 99\n}missing
2162Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231226_230952__44430.031.71182[86, 241]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_230952__444.json100.0missing{\n "num_gpu": 99\n}missing
2163Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_022441__24030.029.04992[126, 215]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_022441__240.json100.0missing{\n "num_gpu": 99\n}missing
2164Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_022508__84830.026.91982[126, 198]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_022508__848.json100.0missing{\n "num_gpu": 99\n}missing
2165Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_162919__48230.029.37782[126, 219]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_162919__482.json100.0missing{\n "num_gpu": 99\n}missing
2166Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_162939__48930.020.61282[126, 148]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_162939__489.json100.0missing{\n "num_gpu": 99\n}missing
2167Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231226_230921__25030.026.06442[126, 191]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_230921__250.json100.0missing{\n "num_gpu": 99\n}missing
2168Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_022354__93930.043.30922[208, 131]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022354__939.json100.0missing{\n "num_gpu": 99\n}missing
2169Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_022411__90430.017.04552[208, 102]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022411__904.json100.0missing{\n "num_gpu": 99\n}missing
2170Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_162819__15030.062.2642[208, 291]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162819__150.json100.0missing{\n "num_gpu": 99\n}missing
2171Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse320231225_162849__21700.030.24350[208, 209]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162849__217.json25.0missing{\n "num_gpu": 99\n}missing
2172Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231226_230854__29630.066.85532[208, 333]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230854__296.json100.0missing{\n "num_gpu": 99\n}missing
2173Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_022854__55530.054.91232[390, 365]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022854__555.json100.0missing{\n "num_gpu": 99\n}missing
2174Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_022919__44630.024.97242[390, 132]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022919__446.json100.0missing{\n "num_gpu": 99\n}missing
2175Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_163311__64630.021.05632[390, 102]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_163311__646.json100.0missing{\n "num_gpu": 99\n}missing
2176Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse320231225_163342__91300.030.43320[390, 176]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_163342__913.json25.0missing{\n "num_gpu": 99\n}missing
2177Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231226_231055__31030.020.94442[390, 101]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231055__310.json100.0missing{\n "num_gpu": 99\n}missing
2178Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse320231225_022724__79600.035.38620[387, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_022724__796.json25.0missing{\n "num_gpu": 99\n}missing
2179Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue320231225_022759__42030.035.76492[387, 217]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_022759__420.json100.0missing{\n "num_gpu": 99\n}missing
2180Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse320231225_163203__37300.031.20060[387, 181]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_163203__373.json25.0missing{\n "num_gpu": 99\n}missing
2181Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue320231225_163250__19730.046.92672[387, 305]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_163250__197.json100.0missing{\n "num_gpu": 99\n}missing
2182Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse320231226_231034__65900.041.20170[387, 260]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_231034__659.json25.0missing{\n "num_gpu": 99\n}missing
2183Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue320231225_023840__68500.09.309662[79, 152]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_023840__685.json75.0missing{\n "num_gpu": 99\n}missing
2184Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse320231225_023858__81600.017.74140[79, 299]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_023858__816.json25.0missing{\n "num_gpu": 99\n}missing
2185Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue320231225_164249__12100.09.877582[79, 162]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_164249__121.json75.0missing{\n "num_gpu": 99\n}missing
2186Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse320231225_164305__73600.015.74250[79, 265]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_164305__736.json25.0missing{\n "num_gpu": 99\n}missing
2187Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse320231226_231518__29200.010.73840[79, 177]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_231518__292.json25.0missing{\n "num_gpu": 99\n}missing
2188Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231225_023823__38100.010.63940[121, 170]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023823__381.json0.0missing{\n "num_gpu": 99\n}missing
2189Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231225_023831__27700.08.480930[121, 132]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023831__277.json0.0missing{\n "num_gpu": 99\n}missing
2190Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164230__79630.014.96362[121, 246]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164230__796.json100.0missing{\n "num_gpu": 99\n}missing
2191Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164239__50000.09.394632[121, 148]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164239__500.json75.0missing{\n "num_gpu": 99\n}missing
2192Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231226_231507__97000.04.840490[121, 68]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231507__970.json0.0missing{\n "num_gpu": 99\n}missing
2193Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_023757__76800.022.35640[202, 195]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023757__768.json25.0missing{\n "num_gpu": 99\n}missing
2194Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_023812__31300.014.62490[202, 225]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023812__313.json25.0missing{\n "num_gpu": 99\n}missing
2195Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_164200__59500.024.47620[202, 240]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164200__595.json25.0missing{\n "num_gpu": 99\n}missing
2196Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_164215__14500.014.94030[202, 230]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164215__145.json25.0missing{\n "num_gpu": 99\n}missing
2197Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231226_231502__69000.023.26290[202, 226]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231502__690.json25.0missing{\n "num_gpu": 99\n}missing
2198Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231225_024001__71300.015.00780[388, 202]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024001__713.json0.0missing{\n "num_gpu": 99\n}missing
2199Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231225_024015__61200.013.99520[388, 185]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024015__612.json0.0missing{\n "num_gpu": 99\n}missing
2200Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_164434__88600.022.11330[388, 322]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164434__886.json25.0missing{\n "num_gpu": 99\n}missing
2201Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231225_164451__21300.016.20740[388, 223]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164451__213.json0.0missing{\n "num_gpu": 99\n}missing
2202Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231226_231546__48600.014.11040[388, 187]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231546__486.json0.0missing{\n "num_gpu": 99\n}missing
2203Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023930__52400.013.76032[386, 181]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023930__524.json75.0missing{\n "num_gpu": 99\n}missing
2204Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023946__74830.016.24222[386, 223]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023946__748.json100.0missing{\n "num_gpu": 99\n}missing
2205Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse320231225_164352__90500.015.93370[386, 218]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164352__905.json25.0missing{\n "num_gpu": 99\n}missing
2206Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse320231225_164412__34300.020.48310[386, 295]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164412__343.json25.0missing{\n "num_gpu": 99\n}missing
2207Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse320231226_231532__22000.014.39490[386, 192]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231532__220.json25.0missing{\n "num_gpu": 99\n}missing
2208Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTtruefalse320231225_022003__93300.06.596640[81, 372]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_022003__933.json25.0missing{\n "num_gpu": 99\n}missing
2209Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTtruefalse320231225_022006__20300.02.692170[81, 150]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_022006__203.json25.0missing{\n "num_gpu": 99\n}missing
2210Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTtruefalse320231225_162409__91400.06.222030[81, 354]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_162409__914.json25.0missing{\n "num_gpu": 99\n}missing
2211Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTtruefalse320231225_162412__57800.03.413420[81, 193]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_162412__578.json25.0missing{\n "num_gpu": 99\n}missing
2212Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTtruefalse320231226_230620__80700.06.315140[81, 357]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_230620__807.json25.0missing{\n "num_gpu": 99\n}missing
2213Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_021956__32400.01.563280[118, 77]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_021956__324.json0.0missing{\n "num_gpu": 99\n}missing
2214Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_021957__93600.01.152110[118, 51]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_021957__936.json0.0missing{\n "num_gpu": 99\n}missing
2215Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_162400__93900.01.289420[118, 61]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_162400__939.json0.0missing{\n "num_gpu": 99\n}missing
2216Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_162403__41400.02.940060[118, 159]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_162403__414.json0.0missing{\n "num_gpu": 99\n}missing
2217Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231226_230614__22700.02.541520[118, 135]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_230614__227.json0.0missing{\n "num_gpu": 99\n}missing
2218Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_021949__95700.06.36830[196, 168]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021949__957.json0.0missing{\n "num_gpu": 99\n}missing
2219Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_021954__33900.04.784610[196, 244]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021954__339.json0.0missing{\n "num_gpu": 99\n}missing
2220Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse320231225_162352__23000.07.150430[196, 232]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162352__230.json25.0missing{\n "num_gpu": 99\n}missing
2221Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_162358__45500.06.72910[196, 353]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162358__455.json0.0missing{\n "num_gpu": 99\n}missing
2222Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse320231226_230611__18700.06.873980[196, 209]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230611__187.json25.0missing{\n "num_gpu": 99\n}missing
2223Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse320231225_022034__60900.08.897580[368, 416]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022034__609.json25.0missing{\n "num_gpu": 99\n}missing
2224Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231225_022039__48500.04.966160[368, 213]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022039__485.json0.0missing{\n "num_gpu": 99\n}missing
2225Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse320231225_162438__69400.07.300460[368, 336]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162438__694.json25.0missing{\n "num_gpu": 99\n}missing
2226Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse320231225_162444__45500.05.04310[368, 219]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162444__455.json25.0missing{\n "num_gpu": 99\n}missing
2227Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231226_230632__10200.05.938170[368, 265]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230632__102.json0.0missing{\n "num_gpu": 99\n}missing
2228Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTtruefalse320231225_022019__55900.08.048990[366, 373]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_022019__559.json25.0missing{\n "num_gpu": 99\n}missing
2229Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTtruefalse320231225_022025__99200.05.233320[366, 228]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_022025__992.json25.0missing{\n "num_gpu": 99\n}missing
2230Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTtruefalse320231225_162426__81900.07.03320[366, 324]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_162426__819.json25.0missing{\n "num_gpu": 99\n}missing
2231Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse320231225_162431__51200.05.421250[366, 240]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_162431__512.json0.0missing{\n "num_gpu": 99\n}missing
2232Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTtruefalse320231226_230626__37500.05.893450[366, 263]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_230626__375.json25.0missing{\n "num_gpu": 99\n}missing
2233Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_020334__10400.04.299722[79, 130]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_020334__104.json75.0missing{\n "num_gpu": 99\n}missing
2234Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_020340__93630.06.434842[79, 201]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_020340__936.json100.0missing{\n "num_gpu": 99\n}missing
2235Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_160920__41100.06.74322[79, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_160920__411.json75.0missing{\n "num_gpu": 99\n}missing
2236Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruefalse320231225_160930__98900.09.076420[79, 290]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_160930__989.json25.0missing{\n "num_gpu": 99\n}missing
2237Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231226_225942__95630.06.706322[79, 211]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_225942__956.json100.0missing{\n "num_gpu": 99\n}missing
2238Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_020323__33830.05.409492[121, 162]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_020323__338.json100.0missing{\n "num_gpu": 99\n}missing
2239Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_020329__49130.06.403852[121, 195]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_020329__491.json100.0missing{\n "num_gpu": 99\n}missing
2240Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_160909__21000.05.95572[121, 181]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_160909__210.json75.0missing{\n "num_gpu": 99\n}missing
2241Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_160914__27530.04.660732[121, 138]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_160914__275.json100.0missing{\n "num_gpu": 99\n}missing
2242Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231226_225935__94430.05.128132[121, 153]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_225935__944.json100.0missing{\n "num_gpu": 99\n}missing
2243Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue320231225_020304__63200.016.75762[202, 335]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020304__632.json75.0missing{\n "num_gpu": 99\n}missing
2244Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse320231225_020317__77100.013.18620[202, 397]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020317__771.json25.0missing{\n "num_gpu": 99\n}missing
2245Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse320231225_160855__21500.018.21510[202, 391]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160855__215.json25.0missing{\n "num_gpu": 99\n}missing
2246Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse320231225_160903__17800.08.376730[202, 246]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160903__178.json25.0missing{\n "num_gpu": 99\n}missing
2247Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse320231226_225930__37400.014.1790[202, 266]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225930__374.json25.0missing{\n "num_gpu": 99\n}missing
2248Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_020434__46900.011.02872[388, 294]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020434__469.json75.0missing{\n "num_gpu": 99\n}missing
2249Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse320231225_020450__74100.016.04860[388, 450]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020450__741.json25.0missing{\n "num_gpu": 99\n}missing
2250Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_161017__78230.011.06972[388, 298]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161017__782.json100.0missing{\n "num_gpu": 99\n}missing
2251Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_161025__47330.08.427162[388, 214]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161025__473.json100.0missing{\n "num_gpu": 99\n}missing
2252Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231226_225959__99500.07.03042[388, 168]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225959__995.json75.0missing{\n "num_gpu": 99\n}missing
2253Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruefalse320231225_020409__91100.012.76910[386, 349]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_020409__911.json25.0missing{\n "num_gpu": 99\n}missing
2254Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruefalse320231225_020423__76800.014.20250[386, 393]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_020423__768.json25.0missing{\n "num_gpu": 99\n}missing
2255Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231225_160954__62100.08.587212[386, 219]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_160954__621.json75.0missing{\n "num_gpu": 99\n}missing
2256Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruefalse320231225_161006__81300.011.16010[386, 300]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_161006__813.json25.0missing{\n "num_gpu": 99\n}missing
2257Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231226_225952__15730.09.84372[386, 258]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_225952__157.json100.0missing{\n "num_gpu": 99\n}missing
2258Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruetrue320231225_020704__51700.037.63752[78, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_020704__517.json75.0missing{\n "num_gpu": 99\n}missing
2259Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruefalse320231225_020740__60200.033.92290[78, 247]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_020740__602.json25.0missing{\n "num_gpu": 99\n}missing
2260Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruetrue320231225_161311__67230.051.44772[78, 389]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_161311__672.json100.0missing{\n "num_gpu": 99\n}missing
2261Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruefalse320231225_161359__46500.048.16920[78, 364]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_161359__465.json25.0missing{\n "num_gpu": 99\n}missing
2262Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruefalse320231226_230151__45900.057.15220[78, 431]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_230151__459.json25.0missing{\n "num_gpu": 99\n}missing
2263Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruefalse320231225_020608__77000.018.20340[117, 123]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_020608__770.json25.0missing{\n "num_gpu": 99\n}missing
2264Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231225_020626__69030.017.93652[117, 121]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_020626__690.json100.0missing{\n "num_gpu": 99\n}missing
2265Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231225_161204__19930.018.48522[117, 126]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_161204__199.json100.0missing{\n "num_gpu": 99\n}missing
2266Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231225_161220__63830.015.15742[117, 100]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_161220__638.json100.0missing{\n "num_gpu": 99\n}missing
2267Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231226_230054__31830.015.70492[117, 104]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_230054__318.json100.0missing{\n "num_gpu": 99\n}missing
2268Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue320231225_020533__12330.042.70782[197, 109]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020533__123.json100.0missing{\n "num_gpu": 99\n}missing
2269Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse320231225_020550__46500.016.81750[197, 96]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020550__465.json25.0missing{\n "num_gpu": 99\n}missing
2270Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue320231225_161110__43030.044.9032[197, 132]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161110__430.json100.0missing{\n "num_gpu": 99\n}missing
2271Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse320231225_161146__70900.035.67320[197, 244]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161146__709.json25.0missing{\n "num_gpu": 99\n}missing
2272Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue320231226_230038__13930.038.88092[197, 94]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230038__139.json100.0missing{\n "num_gpu": 99\n}missing
2273Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_021155__53430.045.58822[391, 280]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021155__534.json100.0missing{\n "num_gpu": 99\n}missing
2274Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_021232__52230.036.97792[391, 216]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021232__522.json100.0missing{\n "num_gpu": 99\n}missing
2275Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_161735__66730.017.73262[391, 71]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161735__667.json100.0missing{\n "num_gpu": 99\n}missing
2276Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse320231225_161848__45000.072.52640[391, 477]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161848__450.json25.0missing{\n "num_gpu": 99\n}missing
2277Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231226_230358__47930.037.53512[391, 221]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230358__479.json100.0missing{\n "num_gpu": 99\n}missing
2278Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_021039__27930.049.61542[389, 310]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_021039__279.json100.0missing{\n "num_gpu": 99\n}missing
2279Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_021110__79730.030.73912[389, 169]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_021110__797.json100.0missing{\n "num_gpu": 99\n}missing
2280Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_161653__12830.083.93962[389, 556]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_161653__128.json100.0missing{\n "num_gpu": 99\n}missing
2281Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_161718__76530.024.78172[389, 126]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_161718__765.json100.0missing{\n "num_gpu": 99\n}missing
2282Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231226_230320__47430.088.82422[389, 597]0.6.021.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_230320__474.json100.0missing{\n "num_gpu": 99\n}missing
2283Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTfalsefalse520231214_003153__44300.011.19140[79, 332]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_003153__443.json0.0missingmissingmissing
2284Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTtruetrue520231225_025911__61300.06.007180[87, 100]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_025911__613.json50.0missing{\n "num_gpu": 99\n}missing
2285Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTtruetrue520231225_025925__98700.013.82360[87, 248]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_025925__987.json50.0missing{\n "num_gpu": 99\n}missing
2286Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTtruetrue520231226_232707__98820.09.900143[87, 175]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_232707__988.json85.0missing{\n "num_gpu": 99\n}missing
2287Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_003142__57300.04.89660[108, 131]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_003142__573.json50.0missingmissingmissing
2288Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_025902__39100.02.804730[125, 34]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_025902__391.json0.0missing{\n "num_gpu": 99\n}missing
2289Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_025905__64830.03.119032[125, 40]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_025905__648.json81.6667missing{\n "num_gpu": 99\n}missing
2290Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_232657__13100.02.849710[125, 35]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_232657__131.json50.0missing{\n "num_gpu": 99\n}missing
2291Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231214_003137__83600.015.24710[184, 412]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003137__836.json25.0missingmissingmissing
2292Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_025855__55600.023.47610[202, 220]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025855__556.json50.0missing{\n "num_gpu": 99\n}missing
2293Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_025859__12700.03.411570[202, 31]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025859__127.json0.0missing{\n "num_gpu": 99\n}missing
2294Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_232654__48800.021.90480[202, 200]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232654__488.json0.0missing{\n "num_gpu": 99\n}missing
2295Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_003231__88300.014.48420[11, 398]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003231__883.json50.0missingmissingmissing
2296Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_030040__38400.013.04180[390, 178]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030040__384.json50.0missing{\n "num_gpu": 99\n}missing
2297Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_030100__35600.019.76730[390, 298]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030100__356.json50.0missing{\n "num_gpu": 99\n}missing
2298Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_232736__87850.015.18893[390, 217]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232736__878.json100.0missing{\n "num_gpu": 99\n}missing
2299Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231214_003216__77500.014.43190[379, 312]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_003216__775.json50.0missingmissingmissing
2300Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_030008__59450.014.50093[387, 204]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_030008__594.json100.0missing{\n "num_gpu": 99\n}missing
2301Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_030027__67600.018.72190[387, 280]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_030027__676.json50.0missing{\n "num_gpu": 99\n}missing
2302Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_232721__45950.013.82813[387, 193]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_232721__459.json100.0missing{\n "num_gpu": 99\n}missing
2303Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonInJulia1SHOTtruefalse520231214_003303__22000.013.9630[79, 413]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_003303__220.json25.0missingmissingmissing
2304Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonInJulia1SHOTfalsefalse520231225_030135__93100.04.123220[61, 69]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_030135__931.json0.0missing{\n "num_gpu": 99\n}missing
2305Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonInJulia1SHOTfalsefalse520231225_030139__70200.03.92060[61, 65]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_030139__702.json0.0missing{\n "num_gpu": 99\n}missing
2306Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231214_003249__95800.05.447910[108, 148]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_003249__958.json25.0missingmissingmissing
2307Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_030121__76000.04.434390[62, 75]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_030121__760.json0.0missing{\n "num_gpu": 99\n}missing
2308Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_030131__18100.010.7150[62, 195]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_030131__181.json0.0missing{\n "num_gpu": 99\n}missing
2309Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_003244__65400.012.73060[184, 341]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003244__654.json50.0missingmissingmissing
2310Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_030113__96600.012.91260[77, 41]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030113__966.json0.0missing{\n "num_gpu": 99\n}missing
2311Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_030116__99000.02.876170[77, 40]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030116__990.json0.0missing{\n "num_gpu": 99\n}missing
2312Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231214_003339__89900.011.61740[11, 322]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003339__899.json0.0missingmissingmissing
2313Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_030159__28400.00.8577510[79, 1]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030159__284.json0.0missing{\n "num_gpu": 99\n}missing
2314Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_030200__75500.01.319220[79, 10]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030200__755.json0.0missing{\n "num_gpu": 99\n}missing
2315Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_003327__69900.017.70370[379, 399]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_003327__699.json0.0missingmissingmissing
2316Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_030145__25400.01.89310[76, 21]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_030145__254.json0.0missing{\n "num_gpu": 99\n}missing
2317Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_030158__55300.013.14110[76, 236]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_030158__553.json0.0missing{\n "num_gpu": 99\n}missing
2318Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_225943__73400.011.64480[1, 363]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_225943__734.json25.0missingmissingmissing
2319Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_225952__96200.09.138870[1, 289]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_225952__962.json25.0missingmissingmissing
2320Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_031420__69350.043.06733[79, 257]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_031420__693.json100.0missing{\n "num_gpu": 99\n}missing
2321Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_031457__43350.037.03073[79, 219]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_031457__433.json100.0missing{\n "num_gpu": 99\n}missing
2322Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_233403__34140.023.76522[79, 136]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_233403__341.json86.6667missing{\n "num_gpu": 99\n}missing
2323Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_225908__98300.010.39140[1, 322]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_225908__983.json25.0missingmissingmissing
2324Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_225915__61300.07.621560[1, 240]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_225915__613.json25.0missingmissingmissing
2325Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_031323__46000.032.60240[120, 185]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_031323__460.json0.0missing{\n "num_gpu": 99\n}missing
2326Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_031337__77700.013.91640[120, 69]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_031337__777.json0.0missing{\n "num_gpu": 99\n}missing
2327Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_233339__19800.044.5820[120, 262]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233339__198.json0.0missing{\n "num_gpu": 99\n}missing
2328Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_225844__42400.012.07720[1, 362]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_225844__424.json25.0missingmissingmissing
2329Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_225852__79700.08.05210[1, 246]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_225852__797.json25.0missingmissingmissing
2330Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_031233__28250.048.53713[196, 93]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_031233__282.json100.0missing{\n "num_gpu": 99\n}missing
2331Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_031250__81600.017.180[196, 75]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_031250__816.json0.0missing{\n "num_gpu": 99\n}missing
2332Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_233255__96100.049.84790[196, 135]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233255__961.json0.0missing{\n "num_gpu": 99\n}missing
2333Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230142__40800.016.72980[1, 464]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230142__408.json25.0missingmissingmissing
2334Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230159__19100.017.15450[1, 475]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230159__191.json25.0missingmissingmissing
2335Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_031754__47040.038.37193[408, 174]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031754__470.json95.0missing{\n "num_gpu": 99\n}missing
2336Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_031825__42150.030.8253[408, 128]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031825__421.json100.0missing{\n "num_gpu": 99\n}missing
2337Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233541__27740.034.15992[408, 149]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233541__277.json86.6667missing{\n "num_gpu": 99\n}missing
2338Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230053__91500.018.57750[1, 512]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230053__915.json25.0missingmissingmissing
2339Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230112__78900.018.98010[1, 522]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230112__789.json25.0missingmissingmissing
2340Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_031633__65940.043.73543[406, 206]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_031633__659.json95.0missing{\n "num_gpu": 99\n}missing
2341Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_031715__87950.041.92023[406, 195]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_031715__879.json100.0missing{\n "num_gpu": 99\n}missing
2342Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233507__29240.063.00823[406, 323]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233507__292.json95.0missing{\n "num_gpu": 99\n}missing
2343Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231226_234106__53500.07.57760[78, 291]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_234106__535.json50.0missing{\n "num_gpu": 99\n}missing
2344Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_111332__62900.05.448290[78, 208]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_111332__629.json25.0missing{\n "num_gpu": 99\n}missing
2345Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_111337__32500.05.590570[78, 214]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_111337__325.json50.0missing{\n "num_gpu": 99\n}missing
2346Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_111342__90100.05.303030[78, 203]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_111342__901.json50.0missing{\n "num_gpu": 99\n}missing
2347Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231226_234058__26400.07.248330[115, 273]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_234058__264.json50.0missing{\n "num_gpu": 99\n}missing
2348Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_111318__64700.01.444520[115, 45]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_111318__647.json0.0missing{\n "num_gpu": 99\n}missing
2349Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_111325__96500.06.157280[115, 231]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_111325__965.json0.0missing{\n "num_gpu": 99\n}missing
2350Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_111326__16600.01.41340[115, 44]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_111326__166.json0.0missing{\n "num_gpu": 99\n}missing
2351Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_234051__62400.05.408310[189, 58]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234051__624.json0.0missing{\n "num_gpu": 99\n}missing
2352Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_111308__97300.05.477140[189, 67]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111308__973.json0.0missing{\n "num_gpu": 99\n}missing
2353Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_111312__77000.04.205160[189, 145]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111312__770.json50.0missing{\n "num_gpu": 99\n}missing
2354Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_111317__39200.04.925510[189, 172]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111317__392.json0.0missing{\n "num_gpu": 99\n}missing
2355Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_234120__94500.03.685420[367, 95]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234120__945.json0.0missing{\n "num_gpu": 99\n}missing
2356Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_111406__27100.03.524260[367, 89]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111406__271.json0.0missing{\n "num_gpu": 99\n}missing
2357Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_111413__71100.06.177450[367, 188]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111413__711.json0.0missing{\n "num_gpu": 99\n}missing
2358Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_111422__35900.09.248370[367, 301]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111422__359.json50.0missing{\n "num_gpu": 99\n}missing
2359Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231226_234116__93900.010.08070[364, 331]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_234116__939.json0.0missing{\n "num_gpu": 99\n}missing
2360Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_111350__23900.07.414230[364, 234]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_111350__239.json50.0missing{\n "num_gpu": 99\n}missing
2361Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_111354__40600.04.152470[364, 113]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_111354__406.json0.0missing{\n "num_gpu": 99\n}missing
2362Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_111403__65500.08.709990[364, 282]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_111403__655.json0.0missing{\n "num_gpu": 99\n}missing
2363Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTfalsefalse520231214_002656__19300.013.91540[79, 412]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231214_002656__193.json0.0missingmissingmissing
2364Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTfalsefalse520231225_024631__43700.011.6770[79, 347]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231225_024631__437.json0.0missing{\n "num_gpu": 99\n}missing
2365Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTtruefalse520231225_024643__86000.011.65120[1, 362]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231225_024643__860.json25.0missing{\n "num_gpu": 99\n}missing
2366Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTtruetrue520231226_232107__86800.013.06930[79, 393]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231226_232107__868.json50.0missing{\n "num_gpu": 99\n}missing
2367Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTfalsefalse520231214_002642__29500.06.95090[108, 195]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_002642__295.json0.0missingmissingmissing
2368Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTtruetrue520231225_024613__19300.09.841250[108, 282]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_024613__193.json50.0missing{\n "num_gpu": 99\n}missing
2369Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTfalsefalse520231225_024619__55700.05.857330[1, 184]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_024619__557.json0.0missing{\n "num_gpu": 99\n}missing
2370Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTtruefalse520231226_232054__49700.05.004780[108, 137]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_232054__497.json25.0missing{\n "num_gpu": 99\n}missing
2371Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTtruefalse520231214_002635__47800.014.97560[184, 404]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002635__478.json25.0missingmissingmissing
2372Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_024550__95000.022.36120[202, 461]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024550__950.json0.0missing{\n "num_gpu": 99\n}missing
2373Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_024603__76700.013.44830[1, 399]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024603__767.json0.0missing{\n "num_gpu": 99\n}missing
2374Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_232049__35600.013.4330[202, 223]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232049__356.json0.0missing{\n "num_gpu": 99\n}missing
2375Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231214_002740__23300.018.68910[11, 508]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_002740__233.json50.0missingmissingmissing
2376Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231225_024742__66600.010.08790[11, 281]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024742__666.json50.0missing{\n "num_gpu": 99\n}missing
2377Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231225_024755__41000.012.05840[1, 339]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024755__410.json50.0missing{\n "num_gpu": 99\n}missing
2378Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231226_232135__70500.012.40740[11, 349]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232135__705.json50.0missing{\n "num_gpu": 99\n}missing
2379Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTfalsefalse520231214_002721__84000.018.73360[379, 426]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_002721__840.json0.0missingmissingmissing
2380Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTtruetrue520231225_024715__31000.017.17370[379, 385]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_024715__310.json50.0missing{\n "num_gpu": 99\n}missing
2381Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTfalsefalse520231225_024732__89800.017.30480[1, 477]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_024732__898.json0.0missing{\n "num_gpu": 99\n}missing
2382Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTfalsefalse520231226_232123__40900.015.68680[379, 351]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_232123__409.json0.0missing{\n "num_gpu": 99\n}missing
2383Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruefalse520231214_003418__32300.014.20080[79, 420]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231214_003418__323.json25.0missingmissingmissing
2384Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231225_030235__82330.05.595432[79, 178]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231225_030235__823.json81.6667missing{\n "num_gpu": 99\n}missing
2385Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231225_030241__33950.05.707663[79, 182]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231225_030241__339.json100.0missing{\n "num_gpu": 99\n}missing
2386Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231226_232758__81040.03.518012[79, 107]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231226_232758__810.json86.6667missing{\n "num_gpu": 99\n}missing
2387Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231214_003404__36200.05.899810[108, 162]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_003404__362.json50.0missingmissingmissing
2388Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231225_030225__25900.07.822150[118, 247]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_030225__259.json50.0missing{\n "num_gpu": 99\n}missing
2389Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231225_030230__23950.04.308583[118, 129]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_030230__239.json100.0missing{\n "num_gpu": 99\n}missing
2390Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231226_232755__84340.06.07982[118, 189]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_232755__843.json86.6667missing{\n "num_gpu": 99\n}missing
2391Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTtruefalse520231214_003358__63700.019.0870[184, 518]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003358__637.json25.0missingmissingmissing
2392Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_030210__42100.010.25150[194, 112]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030210__421.json0.0missing{\n "num_gpu": 99\n}missing
2393Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTtruefalse520231225_030217__25200.07.129680[194, 209]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030217__252.json25.0missing{\n "num_gpu": 99\n}missing
2394Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTtruetrue520231226_232748__34500.012.29682[194, 189]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232748__345.json66.6667missing{\n "num_gpu": 99\n}missing
2395Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_003449__64000.012.54990[11, 347]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003449__640.json50.0missingmissingmissing
2396Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_030313__58500.08.6110[382, 228]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030313__585.json50.0missing{\n "num_gpu": 99\n}missing
2397Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_030322__60050.08.503293[382, 225]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030322__600.json100.0missing{\n "num_gpu": 99\n}missing
2398Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_232813__89850.07.716413[382, 200]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232813__898.json100.0missing{\n "num_gpu": 99\n}missing
2399Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTfalsefalse520231214_003437__89400.010.55050[379, 205]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_003437__894.json0.0missingmissingmissing
2400Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231225_030258__16250.08.823983[379, 234]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_030258__162.json100.0missing{\n "num_gpu": 99\n}missing
2401Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231225_030305__49000.06.406020[379, 157]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_030305__490.json50.0missing{\n "num_gpu": 99\n}missing
2402Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231226_232805__63950.07.220573[379, 184]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_232805__639.json100.0missing{\n "num_gpu": 99\n}missing
2403Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180147__26600.020.60720[79, 401]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180147__266.json50.0missing{\n "num_gpu": 99\n}missing
2404Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180150__79100.03.19110[79, 54]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180150__791.json50.0missing{\n "num_gpu": 99\n}missing
2405Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180158__58950.07.643673[79, 144]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180158__589.json100.0missing{\n "num_gpu": 99\n}missing
2406Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180117__53000.04.651450[118, 80]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180117__530.json50.0missing{\n "num_gpu": 99\n}missing
2407Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180120__70050.03.213233[118, 51]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180120__700.json100.0missing{\n "num_gpu": 99\n}missing
2408Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180126__70900.06.185652[118, 111]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180126__709.json66.6667missing{\n "num_gpu": 99\n}missing
2409Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180100__25140.07.701543[194, 131]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180100__251.json95.0missing{\n "num_gpu": 99\n}missing
2410Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180109__25050.09.562833[194, 168]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180109__250.json100.0missing{\n "num_gpu": 99\n}missing
2411Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_180112__47600.02.947950[194, 36]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180112__476.json0.0missing{\n "num_gpu": 99\n}missing
2412Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180241__34330.014.3372[382, 241]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180241__343.json81.6667missing{\n "num_gpu": 99\n}missing
2413Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180251__78440.09.532732[382, 148]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180251__784.json86.6667missing{\n "num_gpu": 99\n}missing
2414Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180258__76050.07.231193[382, 103]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180258__760.json100.0missing{\n "num_gpu": 99\n}missing
2415Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180208__24000.010.15710[379, 160]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180208__240.json50.0missing{\n "num_gpu": 99\n}missing
2416Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180219__84730.010.71712[379, 171]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180219__847.json81.6667missing{\n "num_gpu": 99\n}missing
2417Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180227__14950.07.998933[379, 118]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180227__149.json100.0missing{\n "num_gpu": 99\n}missing
2418Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_230638__59700.013.20830[79, 393]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_230638__597.json25.0missingmissingmissing
2419Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_230644__53100.05.697740[1, 183]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_230644__531.json25.0missingmissingmissing
2420Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_230656__80900.011.9640[1, 373]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_230656__809.json0.0missingmissingmissing
2421Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_233723__56700.02.746450[75, 59]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_233723__567.json50.0missing{\n "num_gpu": 99\n}missing
2422Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230615__68000.09.267270[108, 266]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230615__680.json25.0missingmissingmissing
2423Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_230620__23800.04.959880[1, 158]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230620__238.json0.0missingmissingmissing
2424Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230625__19900.04.966740[1, 158]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230625__199.json25.0missingmissingmissing
2425Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_233720__55700.08.83990[116, 213]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233720__557.json0.0missing{\n "num_gpu": 99\n}missing
2426Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230540__99800.014.58920[184, 395]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230540__998.json25.0missingmissingmissing
2427Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230556__17200.015.60040[1, 460]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230556__172.json25.0missingmissingmissing
2428Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230605__99400.09.688260[1, 294]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230605__994.json0.0missingmissingmissing
2429Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_233711__87400.09.216380[192, 75]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233711__874.json25.0missing{\n "num_gpu": 99\n}missing
2430Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230818__84700.020.00980[11, 542]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230818__847.json25.0missingmissingmissing
2431Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230834__67600.015.88560[1, 442]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230834__676.json25.0missingmissingmissing
2432Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230851__71300.016.57330[1, 460]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230851__713.json25.0missingmissingmissing
2433Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233756__16600.018.80730[383, 421]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233756__166.json50.0missing{\n "num_gpu": 99\n}missing
2434Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230730__64400.017.50380[379, 395]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230730__644.json25.0missingmissingmissing
2435Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230747__47800.017.18730[1, 476]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230747__478.json25.0missingmissingmissing
2436Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230758__56800.011.01290[1, 313]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230758__568.json25.0missingmissingmissing
2437Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231226_233737__24600.014.57610[381, 317]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233737__246.json25.0missing{\n "num_gpu": 99\n}missing
2438Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231840__22750.07.037983[74, 219]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231840__227.json100.0missing{\n "num_gpu": 99\n}missing
2439Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_231847__48400.07.160180[74, 223]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231847__484.json25.0missing{\n "num_gpu": 99\n}missing
2440Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231854__19500.06.882323[74, 214]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231854__195.json75.0missing{\n "num_gpu": 99\n}missing
2441Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231903__88700.08.850040[74, 278]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231903__887.json50.0missing{\n "num_gpu": 99\n}missing
2442Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231914__77600.011.40970[74, 361]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231914__776.json50.0missing{\n "num_gpu": 99\n}missing
2443Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231825__82850.02.134243[115, 51]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231825__828.json100.0missing{\n "num_gpu": 99\n}missing
2444Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231827__42650.01.933833[115, 45]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231827__426.json100.0missing{\n "num_gpu": 99\n}missing
2445Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231829__50950.01.953763[115, 45]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231829__509.json100.0missing{\n "num_gpu": 99\n}missing
2446Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231831__45150.02.026853[115, 48]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231831__451.json100.0missing{\n "num_gpu": 99\n}missing
2447Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231833__72400.01.902110[115, 44]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231833__724.json50.0missing{\n "num_gpu": 99\n}missing
2448Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_231750__98200.012.28110[191, 344]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231750__982.json0.0missing{\n "num_gpu": 99\n}missing
2449Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231759__17000.08.898323[191, 262]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231759__170.json75.0missing{\n "num_gpu": 99\n}missing
2450Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231806__35550.07.667643[191, 222]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231806__355.json100.0missing{\n "num_gpu": 99\n}missing
2451Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231810__85250.03.729643[191, 94]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231810__852.json100.0missing{\n "num_gpu": 99\n}missing
2452Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231823__21800.012.35733[191, 372]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231823__218.json75.0missing{\n "num_gpu": 99\n}missing
2453Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232017__17500.012.75130[382, 348]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232017__175.json50.0missing{\n "num_gpu": 99\n}missing
2454Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232030__87750.012.93833[382, 353]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232030__877.json100.0missing{\n "num_gpu": 99\n}missing
2455Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232041__47340.010.13453[382, 267]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232041__473.json95.0missing{\n "num_gpu": 99\n}missing
2456Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232051__46450.010.03723[382, 264]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232051__464.json100.0missing{\n "num_gpu": 99\n}missing
2457Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232102__11000.010.90770[382, 291]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232102__110.json50.0missing{\n "num_gpu": 99\n}missing
2458Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231925__77900.010.20350[380, 269]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231925__779.json50.0missing{\n "num_gpu": 99\n}missing
2459Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231935__60050.010.18843[380, 269]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231935__600.json100.0missing{\n "num_gpu": 99\n}missing
2460Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231946__28150.011.31653[380, 304]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231946__281.json100.0missing{\n "num_gpu": 99\n}missing
2461Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231954__67850.07.160173[380, 174]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231954__678.json100.0missing{\n "num_gpu": 99\n}missing
2462Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_232005__31650.010.88383[380, 291]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232005__316.json100.0missing{\n "num_gpu": 99\n}missing
2463Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_232215__52400.08.232840[74, 202]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232215__524.json0.0missing{\n "num_gpu": 99\n}missing
2464Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_232226__80950.011.64673[74, 290]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232226__809.json100.0missing{\n "num_gpu": 99\n}missing
2465Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_232235__40900.08.971810[74, 221]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232235__409.json25.0missing{\n "num_gpu": 99\n}missing
2466Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_232246__21900.010.09050[74, 250]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232246__219.json50.0missing{\n "num_gpu": 99\n}missing
2467Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_232255__31950.08.938293[74, 220]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232255__319.json100.0missing{\n "num_gpu": 99\n}missing
2468Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232146__34850.03.021443[115, 61]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232146__348.json100.0missing{\n "num_gpu": 99\n}missing
2469Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232152__99050.05.622163[115, 129]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232152__990.json100.0missing{\n "num_gpu": 99\n}missing
2470Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_232157__31900.05.58980[115, 128]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232157__319.json0.0missing{\n "num_gpu": 99\n}missing
2471Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232201__36650.03.473113[115, 73]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232201__366.json100.0missing{\n "num_gpu": 99\n}missing
2472Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232206__23200.05.69870[115, 131]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232206__232.json50.0missing{\n "num_gpu": 99\n}missing
2473Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232108__42840.06.005592[191, 108]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232108__428.json86.6667missing{\n "num_gpu": 99\n}missing
2474Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232112__94920.04.128433[191, 81]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232112__949.json85.0missing{\n "num_gpu": 99\n}missing
2475Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232122__13000.010.45410[191, 243]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232122__130.json50.0missing{\n "num_gpu": 99\n}missing
2476Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_232130__68200.07.523320[191, 168]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232130__682.json25.0missing{\n "num_gpu": 99\n}missing
2477Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232143__53900.012.76720[191, 302]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232143__539.json50.0missing{\n "num_gpu": 99\n}missing
2478Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_232412__86900.015.2810[382, 333]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232412__869.json25.0missing{\n "num_gpu": 99\n}missing
2479Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_232427__82400.014.95743[382, 325]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232427__824.json75.0missing{\n "num_gpu": 99\n}missing
2480Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_232442__80900.014.60173[382, 316]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232442__809.json75.0missing{\n "num_gpu": 99\n}missing
2481Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_232455__19200.013.38630[382, 286]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232455__192.json25.0missing{\n "num_gpu": 99\n}missing
2482Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_232511__44620.015.73563[382, 344]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232511__446.json85.0missing{\n "num_gpu": 99\n}missing
2483Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232303__85100.08.679320[380, 169]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232303__851.json50.0missing{\n "num_gpu": 99\n}missing
2484Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232317__40900.013.4530[380, 288]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232317__409.json50.0missing{\n "num_gpu": 99\n}missing
2485Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232332__39900.015.12230[380, 329]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232332__399.json50.0missing{\n "num_gpu": 99\n}missing
2486Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232348__32900.015.77040[380, 345]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232348__329.json50.0missing{\n "num_gpu": 99\n}missing
2487Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232357__22250.09.04443[380, 178]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232357__222.json100.0missing{\n "num_gpu": 99\n}missing
2488Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_121236__33100.012.41280[74, 223]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121236__331.json50.0missing{\n "num_gpu": 99\n}missing
2489Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_121250__35250.013.97673[74, 251]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121250__352.json100.0missing{\n "num_gpu": 99\n}missing
2490Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_234006__82350.010.00833[74, 180]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_234006__823.json100.0missing{\n "num_gpu": 99\n}missing
2491Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_121220__35300.03.307620[115, 48]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121220__353.json0.0missing{\n "num_gpu": 99\n}missing
2492Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_121224__74750.03.381963[115, 50]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121224__747.json100.0missing{\n "num_gpu": 99\n}missing
2493Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_233956__46750.03.139463[115, 46]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_233956__467.json100.0missing{\n "num_gpu": 99\n}missing
2494Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_121211__30000.015.15510[191, 261]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121211__300.json50.0missing{\n "num_gpu": 99\n}missing
2495Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_121217__57050.05.714593[191, 83]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121217__570.json100.0missing{\n "num_gpu": 99\n}missing
2496Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_233953__84600.018.92780[191, 168]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233953__846.json25.0missing{\n "num_gpu": 99\n}missing
2497Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_121417__71250.021.49433[382, 353]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121417__712.json100.0missing{\n "num_gpu": 99\n}missing
2498Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_121438__40940.020.84793[382, 346]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121438__409.json95.0missing{\n "num_gpu": 99\n}missing
2499Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_234046__62450.019.79533[382, 326]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234046__624.json100.0missing{\n "num_gpu": 99\n}missing
2500Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121340__51050.018.30953[380, 296]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121340__510.json100.0missing{\n "num_gpu": 99\n}missing
2501Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121355__81950.014.89833[380, 230]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121355__819.json100.0missing{\n "num_gpu": 99\n}missing
2502Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_234026__16950.019.67683[380, 324]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_234026__169.json100.0missing{\n "num_gpu": 99\n}missing
2503Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_111808__91430.026.29352[78, 149]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_111808__914.json81.6667missing{\n "num_gpu": 99\n}missing
2504Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_111839__78450.030.82723[78, 177]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_111839__784.json100.0missing{\n "num_gpu": 99\n}missing
2505Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_111904__48540.024.99153[78, 141]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_111904__485.json95.0missing{\n "num_gpu": 99\n}missing
2506Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_145555__27900.026.88630[78, 152]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_145555__279.json50.0missing{\n "num_gpu": 99\n}missing
2507Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_145617__43440.021.85522[78, 121]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_145617__434.json86.6667missing{\n "num_gpu": 99\n}missing
2508Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_111712__19550.042.20763[117, 241]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_111712__195.json100.0missing{\n "num_gpu": 99\n}missing
2509Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_111733__55400.021.45690[117, 114]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_111733__554.json50.0missing{\n "num_gpu": 99\n}missing
2510Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_111742__35400.08.86380[117, 36]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_111742__354.json0.0missing{\n "num_gpu": 99\n}missing
2511Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_145441__60900.035.46353[117, 199]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_145441__609.json75.0missing{\n "num_gpu": 99\n}missing
2512Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_145528__98150.047.67153[117, 273]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_145528__981.json100.0missing{\n "num_gpu": 99\n}missing
2513Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_111502__89050.039.95993[192, 191]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111502__890.json100.0missing{\n "num_gpu": 99\n}missing
2514Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_111546__60640.044.2022[192, 242]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111546__606.json86.6667missing{\n "num_gpu": 99\n}missing
2515Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_111629__60200.043.03370[192, 235]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111629__602.json25.0missing{\n "num_gpu": 99\n}missing
2516Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_145329__16440.052.3933[192, 290]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_145329__164.json95.0missing{\n "num_gpu": 99\n}missing
2517Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_145405__83000.035.91530[192, 191]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_145405__830.json0.0missing{\n "num_gpu": 99\n}missing
2518Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_112219__35530.038.55773[391, 170]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112219__355.json90.0missing{\n "num_gpu": 99\n}missing
2519Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_112319__83050.060.18153[391, 298]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112319__830.json100.0missing{\n "num_gpu": 99\n}missing
2520Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_112330__36600.010.92270[391, 4]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112330__366.json0.0missing{\n "num_gpu": 99\n}missing
2521Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_145819__73000.011.05750[391, 4]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145819__730.json0.0missing{\n "num_gpu": 99\n}missing
2522Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_145830__31200.011.20110[391, 5]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145830__312.json0.0missing{\n "num_gpu": 99\n}missing
2523Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_111948__38110.044.09523[389, 203]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_111948__381.json80.0missing{\n "num_gpu": 99\n}missing
2524Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_112048__18450.059.62113[389, 295]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_112048__184.json100.0missing{\n "num_gpu": 99\n}missing
2525Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_112140__25050.052.14423[389, 251]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_112140__250.json100.0missing{\n "num_gpu": 99\n}missing
2526Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_145710__19650.052.27773[389, 250]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_145710__196.json100.0missing{\n "num_gpu": 99\n}missing
2527Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_145808__42600.058.40413[389, 286]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_145808__426.json75.0missing{\n "num_gpu": 99\n}missing
2528Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_231006__46900.011.14760[79, 332]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_231006__469.json0.0missingmissingmissing
2529Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_231018__22200.011.59630[1, 362]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_231018__222.json25.0missingmissingmissing
2530Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_231032__43600.014.29710[1, 440]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_231032__436.json25.0missingmissingmissing
2531Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231226_233821__43240.07.893722[83, 193]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_233821__432.json86.6667missing{\n "num_gpu": 99\n}missing
2532Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_230940__69900.05.813750[108, 161]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230940__699.json0.0missingmissingmissing
2533Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230949__17000.08.278260[1, 259]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230949__170.json25.0missingmissingmissing
2534Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230955__21000.06.216790[1, 197]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230955__210.json25.0missingmissingmissing
2535Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_233813__96500.03.242420[124, 67]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233813__965.json50.0missing{\n "num_gpu": 99\n}missing
2536Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230906__47700.015.7790[184, 428]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230906__477.json25.0missingmissingmissing
2537Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230925__66500.018.18690[1, 530]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230925__665.json25.0missingmissingmissing
2538Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230934__71400.09.869720[1, 299]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230934__714.json25.0missingmissingmissing
2539Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_233810__93100.013.62310[200, 169]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233810__931.json50.0missing{\n "num_gpu": 99\n}missing
2540Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_231158__31300.020.7110[11, 560]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231158__313.json25.0missingmissingmissing
2541Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_231207__35600.09.014090[1, 258]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231207__356.json25.0missingmissingmissing
2542Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_231220__19000.012.7750[1, 360]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231220__190.json0.0missingmissingmissing
2543Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233846__19400.011.85280[391, 245]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233846__194.json50.0missing{\n "num_gpu": 99\n}missing
2544Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_231105__54200.015.59120[379, 344]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_231105__542.json25.0missingmissingmissing
2545Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_231124__94300.018.73820[1, 516]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_231124__943.json25.0missingmissingmissing
2546Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_231138__35600.013.77830[1, 387]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_231138__356.json25.0missingmissingmissing
2547Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233834__98700.012.65910[389, 265]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233834__987.json50.0missing{\n "num_gpu": 99\n}missing
2548Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTtruetrue520231214_002811__93900.010.51970[79, 312]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_002811__939.json50.0missingmissingmissing
2549Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTfalsefalse520231225_024825__63200.01.841220[81, 47]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_024825__632.json0.0missing{\n "num_gpu": 99\n}missing
2550Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_024831__99000.05.559640[81, 173]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_024831__990.json50.0missing{\n "num_gpu": 99\n}missing
2551Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTtruetrue520231226_232153__28050.02.361193[81, 65]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_232153__280.json100.0missing{\n "num_gpu": 99\n}missing
2552Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_002800__64700.05.635320[108, 154]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_002800__647.json50.0missingmissingmissing
2553Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_024820__73900.05.763610[122, 174]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_024820__739.json50.0missing{\n "num_gpu": 99\n}missing
2554Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231225_024823__46600.03.452260[122, 97]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_024823__466.json0.0missing{\n "num_gpu": 99\n}missing
2555Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_232151__21300.02.518410[122, 65]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_232151__213.json50.0missing{\n "num_gpu": 99\n}missing
2556Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_002754__19900.014.37290[184, 387]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002754__199.json25.0missingmissingmissing
2557Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_024807__47550.011.91943[198, 184]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024807__475.json100.0missing{\n "num_gpu": 99\n}missing
2558Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_024814__14000.07.28220[198, 209]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024814__140.json50.0missing{\n "num_gpu": 99\n}missing
2559Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_232148__34340.013.16672[198, 239]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232148__343.json86.6667missing{\n "num_gpu": 99\n}missing
2560Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231214_002854__41300.017.65850[11, 482]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_002854__413.json50.0missingmissingmissing
2561Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_024915__24300.07.484890[389, 182]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024915__243.json50.0missing{\n "num_gpu": 99\n}missing
2562Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_024922__29150.07.655943[389, 188]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024922__291.json100.0missing{\n "num_gpu": 99\n}missing
2563Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231226_232207__95800.03.992280[389, 70]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232207__958.json0.0missing{\n "num_gpu": 99\n}missing
2564Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231214_002837__74500.019.77930[379, 453]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_002837__745.json50.0missingmissingmissing
2565Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_024852__19050.09.983893[387, 262]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_024852__190.json100.0missing{\n "num_gpu": 99\n}missing
2566Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_024907__16600.014.62563[387, 406]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_024907__166.json75.0missing{\n "num_gpu": 99\n}missing
2567Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_232203__52350.09.030813[387, 232]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_232203__523.json100.0missing{\n "num_gpu": 99\n}missing
2568Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTtruefalse520231214_003637__78700.013.5980[79, 403]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231214_003637__787.json25.0missingmissingmissing
2569Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTtruetrue520231225_030513__27100.08.109210[82, 139]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231225_030513__271.json50.0missing{\n "num_gpu": 99\n}missing
2570Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTfalsefalse520231225_030519__54300.05.927230[82, 98]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231225_030519__543.json0.0missing{\n "num_gpu": 99\n}missing
2571Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTtruetrue520231226_232909__97800.08.14730[82, 141]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231226_232909__978.json50.0missing{\n "num_gpu": 99\n}missing
2572Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_003623__65800.06.385480[108, 177]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_003623__658.json50.0missingmissingmissing
2573Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_030500__37200.05.101590[121, 78]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_030500__372.json0.0missing{\n "num_gpu": 99\n}missing
2574Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_030504__29400.04.80680[121, 72]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_030504__294.json0.0missing{\n "num_gpu": 99\n}missing
2575Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_232900__59800.04.658080[121, 69]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_232900__598.json0.0missing{\n "num_gpu": 99\n}missing
2576Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_003617__30900.09.709110[184, 254]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003617__309.json50.0missingmissingmissing
2577Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231225_030439__34200.024.6810[197, 249]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030439__342.json25.0missing{\n "num_gpu": 99\n}missing
2578Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_030454__76300.015.16040[197, 250]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030454__763.json50.0missing{\n "num_gpu": 99\n}missing
2579Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231226_232856__63200.023.6560[197, 243]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232856__632.json50.0missing{\n "num_gpu": 99\n}missing
2580Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_003714__30100.011.37020[11, 316]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003714__301.json50.0missingmissingmissing
2581Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_030642__30700.07.678720[385, 80]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030642__307.json0.0missing{\n "num_gpu": 99\n}missing
2582Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_030702__45200.019.89750[385, 299]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030702__452.json0.0missing{\n "num_gpu": 99\n}missing
2583Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231226_232952__45400.025.45670[385, 398]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232952__454.json50.0missing{\n "num_gpu": 99\n}missing
2584Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTtruetrue520231214_003702__81100.018.41490[379, 418]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_003702__811.json50.0missingmissingmissing
2585Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_030614__62900.038.18910[382, 617]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_030614__629.json0.0missing{\n "num_gpu": 99\n}missing
2586Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTtruetrue520231225_030634__45100.019.85910[382, 303]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_030634__451.json50.0missing{\n "num_gpu": 99\n}missing
2587Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTtruetrue520231226_232927__15500.018.03610[382, 272]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_232927__155.json50.0missing{\n "num_gpu": 99\n}missing
2588Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_231330__53700.010.32750[79, 308]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_231330__537.json25.0missingmissingmissing
2589Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_231341__96400.010.92160[1, 342]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_231341__964.json25.0missingmissingmissing
2590Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_231352__56700.011.03460[1, 345]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_231352__567.json25.0missingmissingmissing
2591Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231226_233923__72000.013.29790[72, 508]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_233923__720.json0.0missing{\n "num_gpu": 99\n}missing
2592Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_231306__35600.05.601340[108, 154]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_231306__356.json25.0missingmissingmissing
2593Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_231312__18200.05.793470[1, 184]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_231312__182.json25.0missingmissingmissing
2594Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_231319__16900.07.762620[1, 244]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_231319__169.json25.0missingmissingmissing
2595Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_233909__93900.018.10330[109, 674]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_233909__939.json0.0missing{\n "num_gpu": 99\n}missing
2596Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_231235__42200.014.58960[184, 395]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231235__422.json25.0missingmissingmissing
2597Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_231246__57400.011.04880[1, 333]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231246__574.json0.0missingmissingmissing
2598Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_231300__56600.014.32690[1, 425]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231300__566.json25.0missingmissingmissing
2599Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_233851__65100.05.238120[183, 49]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233851__651.json0.0missing{\n "num_gpu": 99\n}missing
2600Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_231522__34900.023.60750[11, 632]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231522__349.json25.0missingmissingmissing
2601Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231219_231542__42300.019.23790[1, 528]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231542__423.json0.0missingmissingmissing
2602Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_231553__59500.011.46610[1, 325]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231553__595.json25.0missingmissingmissing
2603Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_233934__92400.06.291270[361, 193]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233934__924.json0.0missing{\n "num_gpu": 99\n}missing
2604Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_231426__29100.015.84910[379, 351]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_231426__291.json0.0missingmissingmissing
2605Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_231443__12100.016.96240[1, 470]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_231443__121.json25.0missingmissingmissing
2606Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231219_231459__48700.015.56660[1, 434]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_231459__487.json25.0missingmissingmissing
2607Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_233927__40900.04.926570[358, 142]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_233927__409.json0.0missing{\n "num_gpu": 99\n}missing
2608Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTfalsefalse520231214_003741__34800.09.238320[79, 274]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_003741__348.json0.0missingmissingmissing
2609Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_030900__13140.025.65673[90, 193]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_030900__131.json95.0missing{\n "num_gpu": 99\n}missing
2610Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_030926__72230.025.15712[90, 189]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_030926__722.json81.6667missing{\n "num_gpu": 99\n}missing
2611Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTtruetrue520231226_233110__68530.020.96882[90, 155]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_233110__685.json81.6667missing{\n "num_gpu": 99\n}missing
2612Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_003732__45000.07.687990[108, 217]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_003732__450.json0.0missingmissingmissing
2613Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_030811__96740.011.26342[129, 66]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_030811__967.json86.6667missing{\n "num_gpu": 99\n}missing
2614Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_030835__85430.023.97292[129, 169]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_030835__854.json81.6667missing{\n "num_gpu": 99\n}missing
2615Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_233049__59940.014.01423[129, 89]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_233049__599.json95.0missing{\n "num_gpu": 99\n}missing
2616Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_003724__33100.010.20010[184, 268]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003724__331.json0.0missingmissingmissing
2617Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231225_030737__82000.035.12580[205, 65]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030737__820.json0.0missing{\n "num_gpu": 99\n}missing
2618Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_030759__10730.022.40252[205, 145]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030759__107.json81.6667missing{\n "num_gpu": 99\n}missing
2619Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_233035__21040.042.91612[205, 142]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233035__210.json86.6667missing{\n "num_gpu": 99\n}missing
2620Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231214_003821__68100.018.44290[11, 501]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003821__681.json50.0missingmissingmissing
2621Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_031118__81540.028.17663[393, 156]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031118__815.json95.0missing{\n "num_gpu": 99\n}missing
2622Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_031144__17350.026.00463[393, 139]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031144__173.json100.0missing{\n "num_gpu": 99\n}missing
2623Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231226_233205__70640.034.55793[393, 207]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233205__706.json95.0missing{\n "num_gpu": 99\n}missing
2624Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231214_003802__18000.015.93890[379, 352]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_003802__180.json25.0missingmissingmissing
2625Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_031033__84140.036.44283[390, 222]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_031033__841.json95.0missing{\n "num_gpu": 99\n}missing
2626Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_031050__67150.016.74063[390, 67]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_031050__671.json100.0missing{\n "num_gpu": 99\n}missing
2627Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_233130__19150.019.93643[390, 93]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_233130__191.json100.0missing{\n "num_gpu": 99\n}missing
2628Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_230300__27800.013.19570[79, 393]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_230300__278.json25.0missingmissingmissing
2629Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_230309__55100.08.842770[1, 280]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_230309__551.json0.0missingmissingmissing
2630Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_230314__75500.04.98310[1, 161]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_230314__755.json25.0missingmissingmissing
2631Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231226_233630__53600.012.13260[83, 201]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_233630__536.json50.0missing{\n "num_gpu": 99\n}missing
2632Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230236__89000.06.948680[108, 196]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230236__890.json25.0missingmissingmissing
2633Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230242__72300.05.155850[1, 164]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230242__723.json25.0missingmissingmissing
2634Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_230247__38700.05.507090[1, 175]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230247__387.json25.0missingmissingmissing
2635Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_233618__65100.011.68660[124, 188]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233618__651.json50.0missing{\n "num_gpu": 99\n}missing
2636Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230207__35400.07.998540[184, 205]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230207__354.json0.0missingmissingmissing
2637Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230219__56400.011.75340[1, 353]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230219__564.json0.0missingmissingmissing
2638Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230229__89500.010.70590[1, 323]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230229__895.json25.0missingmissingmissing
2639Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_031849__86600.023.28620[200, 214]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_031849__866.json0.0missing{\n "num_gpu": 99\n}missing
2640Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_233606__41200.025.28070[200, 257]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233606__412.json25.0missing{\n "num_gpu": 99\n}missing
2641Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230450__18800.022.89730[11, 615]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230450__188.json25.0missingmissingmissing
2642Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230504__47100.014.840[1, 415]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230504__471.json25.0missingmissingmissing
2643Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_230525__19200.020.97840[1, 572]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230525__192.json25.0missingmissingmissing
2644Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233702__17800.014.36740[391, 191]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233702__178.json50.0missing{\n "num_gpu": 99\n}missing
2645Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230357__50000.019.03570[379, 435]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230357__500.json25.0missingmissingmissing
2646Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230416__99400.019.48440[1, 535]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230416__994.json25.0missingmissingmissing
2647Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_230427__74800.010.61060[1, 302]0.5.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230427__748.json25.0missingmissingmissing
2648Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233647__38200.016.7220[389, 231]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233647__382.json50.0missing{\n "num_gpu": 99\n}missing
2649Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTfalsefalse520231214_003527__69000.012.44820[79, 370]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_003527__690.json0.0missingmissingmissing
2650Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTtruefalse520231225_030342__43200.04.326450[83, 245]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_030342__432.json25.0missing{\n "num_gpu": 99\n}missing
2651Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTtruetrue520231225_030345__98200.03.569450[83, 201]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_030345__982.json50.0missing{\n "num_gpu": 99\n}missing
2652Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTfalsefalse520231226_232824__35400.02.958550[83, 165]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_232824__354.json0.0missing{\n "num_gpu": 99\n}missing
2653Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231214_003515__38900.08.45580[108, 240]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_003515__389.json25.0missingmissingmissing
2654Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231225_030335__59900.01.356950[120, 65]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_030335__599.json50.0missing{\n "num_gpu": 99\n}missing
2655Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231225_030337__99100.02.058190[120, 106]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_030337__991.json50.0missing{\n "num_gpu": 99\n}missing
2656Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231226_232821__28800.01.91880[120, 98]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_232821__288.json50.0missing{\n "num_gpu": 99\n}missing
2657Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231214_003506__61800.016.78290[184, 454]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003506__618.json25.0missingmissingmissing
2658Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_030330__12500.07.497920[192, 240]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030330__125.json0.0missing{\n "num_gpu": 99\n}missing
2659Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231225_030334__36400.04.266583[192, 220]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030334__364.json75.0missing{\n "num_gpu": 99\n}missing
2660Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_232819__49900.05.269380[192, 123]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232819__499.json0.0missing{\n "num_gpu": 99\n}missing
2661Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231214_003607__71700.017.00850[11, 464]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003607__717.json50.0missingmissingmissing
2662Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_030409__27000.07.322030[370, 336]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030409__270.json50.0missing{\n "num_gpu": 99\n}missing
2663Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_030415__86000.05.91280[370, 263]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030415__860.json25.0missing{\n "num_gpu": 99\n}missing
2664Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_232832__82300.03.741053[370, 148]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232832__823.json75.0missing{\n "num_gpu": 99\n}missing
2665Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_003550__88000.017.3370[379, 389]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_003550__880.json50.0missingmissingmissing
2666Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_030357__47300.03.672840[368, 144]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_030357__473.json25.0missing{\n "num_gpu": 99\n}missing
2667Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_030401__57500.03.931860[368, 159]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_030401__575.json50.0missing{\n "num_gpu": 99\n}missing
2668Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_232828__89900.04.719950[368, 200]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_232828__899.json50.0missing{\n "num_gpu": 99\n}missing
2669Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231214_002922__13840.09.718593[79, 289]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_002922__138.json95.0missingmissingmissing
2670Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231225_025011__96500.06.236120[83, 194]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_025011__965.json50.0missing{\n "num_gpu": 99\n}missing
2671Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231225_025016__46300.04.96520[83, 152]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_025016__463.json50.0missing{\n "num_gpu": 99\n}missing
2672Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231226_232234__64950.04.881083[83, 150]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_232234__649.json100.0missing{\n "num_gpu": 99\n}missing
2673Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_002913__46100.05.600710[108, 153]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_002913__461.json50.0missingmissingmissing
2674Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_024958__38900.04.606810[124, 135]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_024958__389.json50.0missing{\n "num_gpu": 99\n}missing
2675Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_025005__57400.06.253470[124, 190]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_025005__574.json50.0missing{\n "num_gpu": 99\n}missing
2676Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_232229__98500.05.135470[124, 153]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_232229__985.json50.0missing{\n "num_gpu": 99\n}missing
2677Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231214_002907__41000.012.43370[184, 333]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002907__410.json50.0missingmissingmissing
2678Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231225_024944__23700.021.07840[200, 472]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024944__237.json25.0missing{\n "num_gpu": 99\n}missing
2679Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_024954__43820.09.893023[200, 292]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024954__438.json85.0missing{\n "num_gpu": 99\n}missing
2680Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231226_232223__11300.016.77750[200, 350]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232223__113.json50.0missing{\n "num_gpu": 99\n}missing
2681Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_003014__32700.020.39630[11, 551]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003014__327.json0.0missingmissingmissing
2682Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_025051__58750.07.854623[391, 194]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025051__587.json100.0missing{\n "num_gpu": 99\n}missing
2683Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_025059__74500.08.637620[391, 218]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025059__745.json50.0missing{\n "num_gpu": 99\n}missing
2684Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_232301__24100.014.05330[391, 389]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232301__241.json50.0missing{\n "num_gpu": 99\n}missing
2685Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_002954__78500.017.82910[379, 402]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_002954__785.json50.0missingmissingmissing
2686Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_025037__41000.06.587740[389, 153]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_025037__410.json50.0missing{\n "num_gpu": 99\n}missing
2687Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_025043__80700.05.648140[389, 123]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_025043__807.json50.0missing{\n "num_gpu": 99\n}missing
2688Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_232247__84400.012.95140[389, 355]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_232247__844.json50.0missing{\n "num_gpu": 99\n}missing
2689Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTfalsefalse520231214_003045__28400.010.23760[79, 304]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_003045__284.json0.0missingmissingmissing
2690Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTtruetrue520231225_025300__75850.040.48183[78, 302]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_025300__758.json100.0missing{\n "num_gpu": 99\n}missing
2691Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTtruetrue520231225_025341__51050.040.88673[78, 305]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_025341__510.json100.0missing{\n "num_gpu": 99\n}missing
2692Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTtruetrue520231226_232440__99400.048.46992[78, 365]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_232440__994.json66.6667missing{\n "num_gpu": 99\n}missing
2693Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231214_003035__70700.05.23280[108, 142]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_003035__707.json0.0missingmissingmissing
2694Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_025157__36400.08.57650[117, 47]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_025157__364.json50.0missing{\n "num_gpu": 99\n}missing
2695Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231225_025219__83100.021.78830[117, 151]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_025219__831.json0.0missing{\n "num_gpu": 99\n}missing
2696Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_232352__81400.07.64093[117, 40]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_232352__814.json75.0missing{\n "num_gpu": 99\n}missing
2697Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_003030__12600.015.77080[184, 427]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003030__126.json50.0missingmissingmissing
2698Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_025136__78000.036.63133[192, 65]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025136__780.json75.0missing{\n "num_gpu": 99\n}missing
2699Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_025149__71700.012.5720[192, 68]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025149__717.json25.0missing{\n "num_gpu": 99\n}missing
2700Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231226_232344__58450.043.11683[192, 132]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232344__584.json100.0missing{\n "num_gpu": 99\n}missing
2701Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_003122__42000.018.55280[11, 504]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003122__420.json0.0missingmissingmissing
2702Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_025713__77450.064.95763[391, 422]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025713__774.json100.0missing{\n "num_gpu": 99\n}missing
2703Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_025832__72200.078.75420[391, 522]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025832__722.json50.0missing{\n "num_gpu": 99\n}missing
2704Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231226_232632__42300.062.61213[391, 407]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232632__423.json75.0missing{\n "num_gpu": 99\n}missing
2705Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruefalse520231214_003103__18700.011.48660[379, 231]0.4.031.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_003103__187.json25.0missingmissingmissing
2706Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_025534__41550.036.34883[389, 211]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_025534__415.json100.0missing{\n "num_gpu": 99\n}missing
2707Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_025608__63700.033.42010[389, 189]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_025608__637.json25.0missing{\n "num_gpu": 99\n}missing
2708Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_232529__96750.049.29283[389, 309]0.6.031.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_232529__967.json100.0missing{\n "num_gpu": 99\n}missing
2709Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruetrue520231214_004626__45810.015.88631[124, 453]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_004626__458.json60.0missingmissingmissing
2710Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruetrue520231225_171358__90610.014.84611[132, 259]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_171358__906.json60.0missing{\n "num_gpu": 99\n}missing
2711Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruetrue520231225_171426__56300.027.79130[132, 497]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_171426__563.json50.0missing{\n "num_gpu": 99\n}missing
2712Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruefalse520231226_235127__50100.014.99840[132, 260]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_235127__501.json25.0missing{\n "num_gpu": 99\n}missing
2713Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_004610__80910.014.2271[153, 395]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_004610__809.json60.0missingmissingmissing
2714Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_171330__50400.08.517820[170, 134]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_171330__504.json50.0missing{\n "num_gpu": 99\n}missing
2715Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_171343__47240.012.65665[170, 212]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_171343__472.json95.0missing{\n "num_gpu": 99\n}missing
2716Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_235112__30300.016.69360[170, 286]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_235112__303.json50.0missing{\n "num_gpu": 99\n}missing
2717Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231214_004556__24900.019.74050[300, 485]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004556__249.json25.0missingmissingmissing
2718Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_171302__92930.023.84355[318, 214]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171302__929.json90.0missing{\n "num_gpu": 99\n}missing
2719Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_171322__53300.019.4320[318, 312]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171322__533.json50.0missing{\n "num_gpu": 99\n}missing
2720Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231226_235055__38410.026.26821[318, 264]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235055__384.json60.0missing{\n "num_gpu": 99\n}missing
2721Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231214_004703__54000.07.649380[11, 210]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004703__540.json0.0missingmissingmissing
2722Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_171635__89300.036.29260[435, 580]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171635__893.json50.0missing{\n "num_gpu": 99\n}missing
2723Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_171701__84800.025.76240[435, 399]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171701__848.json50.0missing{\n "num_gpu": 99\n}missing
2724Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_235219__98800.022.63990[435, 343]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235219__988.json50.0missing{\n "num_gpu": 99\n}missing
2725Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_004656__69700.015.00890[424, 305]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_004656__697.json0.0missingmissingmissing
2726Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_171540__58810.028.31161[432, 444]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_171540__588.json60.0missing{\n "num_gpu": 99\n}missing
2727Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_171558__72050.018.32145[432, 268]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_171558__720.json100.0missing{\n "num_gpu": 99\n}missing
2728Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231226_235157__14400.030.06820[432, 472]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_235157__144.json25.0missing{\n "num_gpu": 99\n}missing
2729Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonInJulia1SHOTtruefalse520231214_004803__56100.014.7470[124, 422]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_004803__561.json25.0missingmissingmissing
2730Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_171750__21400.08.598460[106, 146]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_171750__214.json0.0missing{\n "num_gpu": 99\n}missing
2731Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_171809__47500.019.31630[106, 348]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_171809__475.json0.0missing{\n "num_gpu": 99\n}missing
2732Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231214_004748__48000.017.47150[153, 485]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_004748__480.json25.0missingmissingmissing
2733Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_171733__76300.08.123220[107, 137]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_171733__763.json25.0missing{\n "num_gpu": 99\n}missing
2734Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_171741__33700.08.288830[107, 140]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_171741__337.json25.0missing{\n "num_gpu": 99\n}missing
2735Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_004731__70310.027.51781[300, 683]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004731__703.json60.0missingmissingmissing
2736Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_171717__40100.016.54290[193, 95]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171717__401.json0.0missing{\n "num_gpu": 99\n}missing
2737Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_171725__49200.07.320470[193, 106]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171725__492.json0.0missing{\n "num_gpu": 99\n}missing
2738Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231214_004935__51500.034.55780[11, 880]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004935__515.json25.0missingmissingmissing
2739Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_172135__21800.01.610380[124, 11]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172135__218.json0.0missing{\n "num_gpu": 99\n}missing
2740Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_172137__34700.01.557440[124, 10]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172137__347.json0.0missing{\n "num_gpu": 99\n}missing
2741Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231214_004901__20600.035.61180[424, 817]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_004901__206.json25.0missingmissingmissing
2742Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_172121__76300.040.57560[121, 728]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_172121__763.json0.0missing{\n "num_gpu": 99\n}missing
2743Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_172133__76600.012.59630[121, 221]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_172133__766.json0.0missing{\n "num_gpu": 99\n}missing
2744Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_231759__69800.019.45110[1, 576]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_231759__698.json25.0missingmissingmissing
2745Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_231818__23300.019.01310[1, 564]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_231818__233.json25.0missingmissingmissing
2746Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_174957__87550.090.36895[122, 530]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_174957__875.json100.0missing{\n "num_gpu": 99\n}missing
2747Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_175045__69700.047.21210[122, 269]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_175045__697.json50.0missing{\n "num_gpu": 99\n}missing
2748Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_000329__57650.096.80715[122, 580]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_000329__576.json100.0missing{\n "num_gpu": 99\n}missing
2749Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_231707__76600.09.019520[1, 277]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_231707__766.json0.0missingmissingmissing
2750Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_231723__53400.015.35040[1, 458]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_231723__534.json0.0missingmissingmissing
2751Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_174723__29950.062.1235[163, 360]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_174723__299.json100.0missing{\n "num_gpu": 99\n}missing
2752Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_174826__96150.061.55015[163, 351]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_174826__961.json100.0missing{\n "num_gpu": 99\n}missing
2753Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_000151__11550.073.88585[163, 431]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_000151__115.json100.0missing{\n "num_gpu": 99\n}missing
2754Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_231633__42900.012.51580[1, 361]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231633__429.json25.0missingmissingmissing
2755Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_231642__26300.09.437160[1, 276]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231642__263.json25.0missingmissingmissing
2756Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_174509__53020.0100.0434[310, 400]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_174509__530.json80.0missing{\n "num_gpu": 99\n}missing
2757Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_174621__95100.071.19540[310, 389]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_174621__951.json25.0missing{\n "num_gpu": 99\n}missing
2758Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_000036__38910.090.7591[310, 369]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_000036__389.json60.0missing{\n "num_gpu": 99\n}missing
2759Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_232119__55100.020.80470[1, 560]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232119__551.json25.0missingmissingmissing
2760Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_232144__71100.025.19820[1, 668]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232144__711.json25.0missingmissingmissing
2761Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_175643__12540.090.91935[451, 479]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_175643__125.json95.0missing{\n "num_gpu": 99\n}missing
2762Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_175811__72150.086.21695[451, 448]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_175811__721.json100.0missing{\n "num_gpu": 99\n}missing
2763Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_000611__53650.084.20615[451, 439]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_000611__536.json100.0missing{\n "num_gpu": 99\n}missing
2764Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_232007__53700.022.95540[1, 614]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232007__537.json25.0missingmissingmissing
2765Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_232040__37500.032.96070[1, 851]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232040__375.json25.0missingmissingmissing
2766Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_175409__35500.082.43260[449, 429]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_175409__355.json50.0missing{\n "num_gpu": 99\n}missing
2767Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_175511__21550.061.30795[449, 304]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_175511__215.json100.0missing{\n "num_gpu": 99\n}missing
2768Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_000447__19610.077.09411[449, 397]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_000447__196.json60.0missing{\n "num_gpu": 99\n}missing
2769Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_001606__81110.010.46371[121, 395]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_001606__811.json60.0missing{\n "num_gpu": 99\n}missing
2770Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_112433__11300.08.356680[121, 315]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_112433__113.json0.0missing{\n "num_gpu": 99\n}missing
2771Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_112444__28300.010.77850[121, 407]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_112444__283.json0.0missing{\n "num_gpu": 99\n}missing
2772Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_112454__88300.010.05750[121, 380]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_112454__883.json25.0missing{\n "num_gpu": 99\n}missing
2773Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_001556__42500.07.003910[158, 258]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_001556__425.json0.0missing{\n "num_gpu": 99\n}missing
2774Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_112414__76000.010.93440[158, 406]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_112414__760.json0.0missing{\n "num_gpu": 99\n}missing
2775Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_112420__47700.05.868590[158, 214]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_112420__477.json0.0missing{\n "num_gpu": 99\n}missing
2776Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_112425__50000.04.443360[158, 159]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_112425__500.json50.0missing{\n "num_gpu": 99\n}missing
2777Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_001549__22800.011.71970[276, 286]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001549__228.json0.0missing{\n "num_gpu": 99\n}missing
2778Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_112344__37300.013.60850[276, 360]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112344__373.json0.0missing{\n "num_gpu": 99\n}missing
2779Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_112348__92110.04.295831[276, 134]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112348__921.json60.0missing{\n "num_gpu": 99\n}missing
2780Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_112403__47500.014.99050[276, 526]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112403__475.json0.0missing{\n "num_gpu": 99\n}missing
2781Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_001626__65400.013.66690[410, 449]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001626__654.json50.0missing{\n "num_gpu": 99\n}missing
2782Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_112530__83100.07.462890[410, 228]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112530__831.json50.0missing{\n "num_gpu": 99\n}missing
2783Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_112535__77210.05.460745[410, 155]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112535__772.json80.0missing{\n "num_gpu": 99\n}missing
2784Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_112543__55210.07.383781[410, 225]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112543__552.json60.0missing{\n "num_gpu": 99\n}missing
2785Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_001612__49710.05.601511[407, 160]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_001612__497.json60.0missing{\n "num_gpu": 99\n}missing
2786Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_112506__50610.012.36221[407, 403]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_112506__506.json60.0missing{\n "num_gpu": 99\n}missing
2787Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_112512__15700.04.942380[407, 135]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_112512__157.json0.0missing{\n "num_gpu": 99\n}missing
2788Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_112522__28600.010.25540[407, 329]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_112522__286.json50.0missing{\n "num_gpu": 99\n}missing
2789Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTtruetrue520231214_003857__67510.015.24011[124, 436]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231214_003857__675.json60.0missingmissingmissing
2790Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTtruefalse520231225_165128__21000.019.03680[124, 543]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231225_165128__210.json25.0missing{\n "num_gpu": 99\n}missing
2791Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTtruetrue520231225_165142__73610.014.72711[1, 447]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231225_165142__736.json60.0missing{\n "num_gpu": 99\n}missing
2792Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTfalsefalse520231226_234205__11700.013.28360[124, 386]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231226_234205__117.json0.0missing{\n "num_gpu": 99\n}missing
2793Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTfalsefalse520231214_003841__34800.04.403150[153, 104]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_003841__348.json0.0missingmissingmissing
2794Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTfalsefalse520231225_165056__53600.013.80850[153, 385]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_165056__536.json0.0missing{\n "num_gpu": 99\n}missing
2795Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTtruetrue520231225_165108__79410.011.9551[1, 363]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_165108__794.json60.0missing{\n "num_gpu": 99\n}missing
2796Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTtruetrue520231226_234152__84110.016.93561[153, 478]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_234152__841.json60.0missing{\n "num_gpu": 99\n}missing
2797Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTtruefalse520231214_003837__13700.016.06410[300, 387]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003837__137.json25.0missingmissingmissing
2798Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTtruefalse520231225_165019__28300.022.63320[318, 433]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165019__283.json25.0missing{\n "num_gpu": 99\n}missing
2799Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTtruefalse520231225_165043__41800.023.89320[1, 658]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165043__418.json25.0missing{\n "num_gpu": 99\n}missing
2800Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_234135__61600.014.97130[318, 233]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234135__616.json0.0missing{\n "num_gpu": 99\n}missing
2801Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231214_003958__92700.015.19940[11, 412]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003958__927.json0.0missingmissingmissing
2802Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_165323__75500.022.25240[11, 592]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165323__755.json0.0missing{\n "num_gpu": 99\n}missing
2803Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTtruefalse520231225_165357__11400.034.14860[1, 879]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165357__114.json25.0missing{\n "num_gpu": 99\n}missing
2804Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231226_234236__77500.018.45740[11, 502]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234236__775.json0.0missing{\n "num_gpu": 99\n}missing
2805Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTfalsefalse520231214_003943__93800.030.86860[424, 705]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_003943__938.json0.0missingmissingmissing
2806Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTtruetrue520231225_165238__20110.024.53271[424, 553]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_165238__201.json60.0missing{\n "num_gpu": 99\n}missing
2807Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTtruefalse520231225_165300__60600.022.45140[1, 602]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_165300__606.json25.0missing{\n "num_gpu": 99\n}missing
2808Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTfalsefalse520231226_234218__37700.012.32870[424, 237]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_234218__377.json0.0missing{\n "num_gpu": 99\n}missing
2809Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231214_005032__55010.016.66281[124, 475]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231214_005032__550.json60.0missingmissingmissing
2810Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231225_172250__37600.016.520[124, 535]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231225_172250__376.json50.0missing{\n "num_gpu": 99\n}missing
2811Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231225_172301__32510.010.09531[124, 325]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231225_172301__325.json60.0missing{\n "num_gpu": 99\n}missing
2812Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231226_235303__25210.011.7461[124, 377]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231226_235303__252.json60.0missing{\n "num_gpu": 99\n}missing
2813Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTfalsefalse520231214_005015__54000.010.99160[153, 303]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_005015__540.json0.0missingmissingmissing
2814Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTtruetrue520231225_172221__34000.010.65090[163, 333]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_172221__340.json50.0missing{\n "num_gpu": 99\n}missing
2815Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTtruetrue520231225_172233__46320.012.26844[163, 387]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_172233__463.json80.0missing{\n "num_gpu": 99\n}missing
2816Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTtruetrue520231226_235251__34200.014.07410[163, 442]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_235251__342.json50.0missing{\n "num_gpu": 99\n}missing
2817Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruefalse520231214_005004__75700.029.14080[300, 723]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005004__757.json25.0missingmissingmissing
2818Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_172156__86800.019.66310[310, 402]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172156__868.json50.0missing{\n "num_gpu": 99\n}missing
2819Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_172210__36200.013.05680[310, 384]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172210__362.json50.0missing{\n "num_gpu": 99\n}missing
2820Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruetrue520231226_235237__86410.017.33821[310, 335]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235237__864.json60.0missing{\n "num_gpu": 99\n}missing
2821Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTfalsefalse520231214_005124__78600.012.88780[11, 352]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005124__786.json0.0missingmissingmissing
2822Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_172407__21100.011.95190[427, 324]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172407__211.json50.0missing{\n "num_gpu": 99\n}missing
2823Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_172425__93400.018.21610[427, 515]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172425__934.json50.0missing{\n "num_gpu": 99\n}missing
2824Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_235332__78630.015.00475[427, 418]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235332__786.json90.0missing{\n "num_gpu": 99\n}missing
2825Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231214_005111__13710.023.24061[424, 518]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_005111__137.json60.0missingmissingmissing
2826Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231225_172340__96710.018.69231[424, 534]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_172340__967.json60.0missing{\n "num_gpu": 99\n}missing
2827Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231225_172354__19100.014.26590[424, 398]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_172354__191.json50.0missing{\n "num_gpu": 99\n}missing
2828Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231226_235317__57900.013.49320[424, 371]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_235317__579.json50.0missing{\n "num_gpu": 99\n}missing
2829Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180522__26600.014.35240[124, 272]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180522__266.json50.0missing{\n "num_gpu": 99\n}missing
2830Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180539__51700.016.92820[124, 323]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180539__517.json50.0missing{\n "num_gpu": 99\n}missing
2831Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180556__89210.017.23631[124, 329]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180556__892.json60.0missing{\n "num_gpu": 99\n}missing
2832Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180426__47910.020.01311[163, 377]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180426__479.json60.0missing{\n "num_gpu": 99\n}missing
2833Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180443__57910.017.20891[163, 322]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180443__579.json60.0missing{\n "num_gpu": 99\n}missing
2834Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180507__66410.023.19921[163, 432]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180507__664.json60.0missing{\n "num_gpu": 99\n}missing
2835Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180322__81510.024.13341[310, 437]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180322__815.json60.0missing{\n "num_gpu": 99\n}missing
2836Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180339__58940.016.57664[310, 292]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180339__589.json90.0missing{\n "num_gpu": 99\n}missing
2837Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_180406__35300.025.36340[310, 460]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180406__353.json25.0missing{\n "num_gpu": 99\n}missing
2838Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180719__98600.027.10190[427, 433]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180719__986.json50.0missing{\n "num_gpu": 99\n}missing
2839Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180743__78600.023.96320[427, 407]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180743__786.json50.0missing{\n "num_gpu": 99\n}missing
2840Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180801__97700.017.8610[427, 298]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180801__977.json50.0missing{\n "num_gpu": 99\n}missing
2841Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180608__77010.011.64161[424, 179]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180608__770.json60.0missing{\n "num_gpu": 99\n}missing
2842Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180634__50910.025.1771[424, 436]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180634__509.json60.0missing{\n "num_gpu": 99\n}missing
2843Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180652__56310.016.69921[424, 263]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180652__563.json60.0missing{\n "num_gpu": 99\n}missing
2844Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_232935__45000.010.01420[1, 310]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_232935__450.json0.0missingmissingmissing
2845Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_232958__19100.022.24510[1, 651]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_232958__191.json25.0missingmissingmissing
2846Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_180456__71910.015.05381[120, 373]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_180456__719.json60.0missing{\n "num_gpu": 99\n}missing
2847Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_180512__27500.016.25330[120, 403]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_180512__275.json25.0missing{\n "num_gpu": 99\n}missing
2848Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231227_000929__46200.013.48520[120, 332]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_000929__462.json0.0missing{\n "num_gpu": 99\n}missing
2849Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_232850__21500.012.23160[1, 370]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232850__215.json25.0missingmissingmissing
2850Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_232902__58500.012.01730[1, 364]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232902__585.json25.0missingmissingmissing
2851Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180430__85700.010.81480[161, 255]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180430__857.json50.0missing{\n "num_gpu": 99\n}missing
2852Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180441__97200.010.320[161, 243]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180441__972.json50.0missing{\n "num_gpu": 99\n}missing
2853Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_000916__41100.012.86790[161, 307]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_000916__411.json50.0missing{\n "num_gpu": 99\n}missing
2854Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_232806__21400.011.23860[1, 326]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232806__214.json25.0missingmissingmissing
2855Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_232818__12200.011.42160[1, 331]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232818__122.json25.0missingmissingmissing
2856Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_180401__95300.021.92710[308, 373]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180401__953.json25.0missing{\n "num_gpu": 99\n}missing
2857Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_180419__84110.018.16831[308, 418]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180419__841.json60.0missing{\n "num_gpu": 99\n}missing
2858Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_000903__30000.038.85340[308, 785]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_000903__300.json25.0missing{\n "num_gpu": 99\n}missing
2859Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_233332__99600.028.74470[1, 752]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233332__996.json25.0missingmissingmissing
2860Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_233356__33400.023.58940[1, 629]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233356__334.json0.0missingmissingmissing
2861Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180641__48010.017.32991[428, 374]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180641__480.json60.0missing{\n "num_gpu": 99\n}missing
2862Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180704__91200.023.24480[428, 519]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180704__912.json50.0missing{\n "num_gpu": 99\n}missing
2863Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_001032__57400.046.12970[428, 1047]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001032__574.json25.0missing{\n "num_gpu": 99\n}missing
2864Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_233203__92200.049.16530[1, 1206]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233203__922.json25.0missingmissingmissing
2865Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_233237__75600.033.22460[1, 857]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233237__756.json25.0missingmissingmissing
2866Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_180556__33000.015.88580[426, 339]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180556__330.json25.0missing{\n "num_gpu": 99\n}missing
2867Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180623__49900.026.94760[426, 608]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180623__499.json50.0missing{\n "num_gpu": 99\n}missing
2868Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_000945__78400.015.89750[426, 340]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_000945__784.json50.0missing{\n "num_gpu": 99\n}missing
2869Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_232730__41400.011.50680[119, 357]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232730__414.json0.0missing{\n "num_gpu": 99\n}missing
2870Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_232749__25600.019.51370[119, 608]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232749__256.json25.0missing{\n "num_gpu": 99\n}missing
2871Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_232804__61000.014.8440[119, 463]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232804__610.json50.0missing{\n "num_gpu": 99\n}missing
2872Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_232817__59840.012.43175[119, 387]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232817__598.json95.0missing{\n "num_gpu": 99\n}missing
2873Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_232836__53100.018.18310[119, 567]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232836__531.json50.0missing{\n "num_gpu": 99\n}missing
2874Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232645__53400.07.357570[160, 218]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232645__534.json0.0missing{\n "num_gpu": 99\n}missing
2875Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232654__55800.08.376930[160, 251]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232654__558.json0.0missing{\n "num_gpu": 99\n}missing
2876Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232702__19600.08.711170[160, 262]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232702__196.json0.0missing{\n "num_gpu": 99\n}missing
2877Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232708__33900.06.121620[160, 178]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232708__339.json0.0missing{\n "num_gpu": 99\n}missing
2878Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_232718__72900.09.599530[160, 290]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232718__729.json50.0missing{\n "num_gpu": 99\n}missing
2879Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_232525__87810.013.75381[307, 373]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232525__878.json60.0missing{\n "num_gpu": 99\n}missing
2880Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_232546__36400.020.03050[307, 582]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232546__364.json25.0missing{\n "num_gpu": 99\n}missing
2881Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_232602__74800.016.16340[307, 462]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232602__748.json25.0missing{\n "num_gpu": 99\n}missing
2882Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_232619__45800.017.30220[307, 501]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232619__458.json25.0missing{\n "num_gpu": 99\n}missing
2883Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_232638__50400.018.44430[307, 534]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232638__504.json25.0missing{\n "num_gpu": 99\n}missing
2884Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233035__41210.020.63681[427, 573]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233035__412.json60.0missing{\n "num_gpu": 99\n}missing
2885Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233053__30700.017.04210[427, 466]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233053__307.json50.0missing{\n "num_gpu": 99\n}missing
2886Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_233104__89700.010.79460[427, 277]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233104__897.json0.0missing{\n "num_gpu": 99\n}missing
2887Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233118__72200.014.64650[427, 395]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233118__722.json50.0missing{\n "num_gpu": 99\n}missing
2888Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233141__66500.023.00170[427, 643]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233141__665.json50.0missing{\n "num_gpu": 99\n}missing
2889Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_232851__92300.015.39540[425, 418]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232851__923.json0.0missing{\n "num_gpu": 99\n}missing
2890Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_232905__95600.014.0210[425, 376]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232905__956.json0.0missing{\n "num_gpu": 99\n}missing
2891Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_232931__45300.025.63210[425, 719]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232931__453.json50.0missing{\n "num_gpu": 99\n}missing
2892Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_232952__49300.020.76420[425, 578]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232952__493.json50.0missing{\n "num_gpu": 99\n}missing
2893Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_233015__14400.023.12230[425, 646]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_233015__144.json25.0missing{\n "num_gpu": 99\n}missing
2894Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233434__32500.012.47160[119, 305]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233434__325.json50.0missing{\n "num_gpu": 99\n}missing
2895Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233449__35100.015.59260[119, 384]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233449__351.json50.0missing{\n "num_gpu": 99\n}missing
2896Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_233505__61900.016.14240[119, 398]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233505__619.json0.0missing{\n "num_gpu": 99\n}missing
2897Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233519__74800.014.04460[119, 345]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233519__748.json50.0missing{\n "num_gpu": 99\n}missing
2898Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233539__78700.019.66610[119, 486]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233539__787.json50.0missing{\n "num_gpu": 99\n}missing
2899Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_233346__56100.05.451560[160, 120]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233346__561.json0.0missing{\n "num_gpu": 99\n}missing
2900Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_233357__79500.011.45130[160, 274]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233357__795.json50.0missing{\n "num_gpu": 99\n}missing
2901Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_233403__63800.05.724930[160, 127]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233403__638.json50.0missing{\n "num_gpu": 99\n}missing
2902Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_233409__84900.06.295880[160, 142]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233409__849.json50.0missing{\n "num_gpu": 99\n}missing
2903Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_233421__31500.011.57340[160, 277]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233421__315.json0.0missing{\n "num_gpu": 99\n}missing
2904Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_233204__61900.023.06430[307, 515]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233204__619.json25.0missing{\n "num_gpu": 99\n}missing
2905Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_233220__88500.015.63090[307, 353]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233220__885.json25.0missing{\n "num_gpu": 99\n}missing
2906Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_233247__46900.026.62270[307, 620]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233247__469.json25.0missing{\n "num_gpu": 99\n}missing
2907Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_233308__54910.021.6721[307, 501]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233308__549.json60.0missing{\n "num_gpu": 99\n}missing
2908Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_233340__44400.031.84060[307, 744]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233340__444.json0.0missing{\n "num_gpu": 99\n}missing
2909Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233807__52000.017.14940[427, 369]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233807__520.json50.0missing{\n "num_gpu": 99\n}missing
2910Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233823__70500.016.12360[427, 344]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233823__705.json50.0missing{\n "num_gpu": 99\n}missing
2911Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_233851__68100.027.8010[427, 624]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233851__681.json25.0missing{\n "num_gpu": 99\n}missing
2912Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233908__99810.017.60261[427, 380]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233908__998.json60.0missing{\n "num_gpu": 99\n}missing
2913Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233934__35000.026.01850[427, 582]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233934__350.json50.0missing{\n "num_gpu": 99\n}missing
2914Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233607__16810.027.62621[425, 620]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233607__168.json60.0missing{\n "num_gpu": 99\n}missing
2915Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233624__48700.016.38620[425, 350]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233624__487.json50.0missing{\n "num_gpu": 99\n}missing
2916Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233642__30500.018.02150[425, 390]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233642__305.json50.0missing{\n "num_gpu": 99\n}missing
2917Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_233718__28800.036.35490[425, 823]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233718__288.json25.0missing{\n "num_gpu": 99\n}missing
2918Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233749__66000.031.33840[425, 707]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233749__660.json50.0missing{\n "num_gpu": 99\n}missing
2919Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_121612__69000.024.21210[119, 442]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121612__690.json50.0missing{\n "num_gpu": 99\n}missing
2920Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_121632__29500.019.7970[119, 357]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121632__295.json0.0missing{\n "num_gpu": 99\n}missing
2921Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_001435__14900.016.19570[119, 292]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_001435__149.json50.0missing{\n "num_gpu": 99\n}missing
2922Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_121529__65700.07.858320[160, 132]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121529__657.json50.0missing{\n "num_gpu": 99\n}missing
2923Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_121548__20900.017.8740[160, 320]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121548__209.json50.0missing{\n "num_gpu": 99\n}missing
2924Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_001419__63700.08.139280[160, 137]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_001419__637.json50.0missing{\n "num_gpu": 99\n}missing
2925Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_121457__54600.019.14970[307, 324]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121457__546.json25.0missing{\n "num_gpu": 99\n}missing
2926Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_121521__77200.023.69480[307, 407]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121521__772.json25.0missing{\n "num_gpu": 99\n}missing
2927Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_001411__92400.041.72231[307, 573]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001411__924.json55.0missing{\n "num_gpu": 99\n}missing
2928Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_121906__89100.038.70660[427, 658]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121906__891.json50.0missing{\n "num_gpu": 99\n}missing
2929Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_121939__59500.033.17040[427, 560]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121939__595.json25.0missing{\n "num_gpu": 99\n}missing
2930Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_001537__40400.024.08530[427, 396]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001537__404.json50.0missing{\n "num_gpu": 99\n}missing
2931Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121747__67800.032.52710[425, 549]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121747__678.json50.0missing{\n "num_gpu": 99\n}missing
2932Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121827__74300.040.09550[425, 683]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121827__743.json50.0missing{\n "num_gpu": 99\n}missing
2933Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231227_001513__90100.037.40310[425, 633]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_001513__901.json50.0missing{\n "num_gpu": 99\n}missing
2934Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_113356__53400.075.03690[123, 438]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_113356__534.json25.0missing{\n "num_gpu": 99\n}missing
2935Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_113523__57500.086.43530[123, 506]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_113523__575.json50.0missing{\n "num_gpu": 99\n}missing
2936Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_113623__73010.059.46731[123, 345]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_113623__730.json60.0missing{\n "num_gpu": 99\n}missing
2937Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_150553__66510.099.54541[123, 581]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_150553__665.json60.0missing{\n "num_gpu": 99\n}missing
2938Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_150710__95910.076.6651[123, 446]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_150710__959.json60.0missing{\n "num_gpu": 99\n}missing
2939Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_113139__44510.063.78521[162, 361]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_113139__445.json60.0missing{\n "num_gpu": 99\n}missing
2940Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_113204__94100.024.15180[162, 121]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_113204__941.json0.0missing{\n "num_gpu": 99\n}missing
2941Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_113241__66300.037.41150[162, 202]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_113241__663.json0.0missing{\n "num_gpu": 99\n}missing
2942Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_150321__20610.027.08971[162, 138]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_150321__206.json60.0missing{\n "num_gpu": 99\n}missing
2943Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_150413__93500.052.19420[162, 290]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_150413__935.json50.0missing{\n "num_gpu": 99\n}missing
2944Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_112734__23610.0110.7921[313, 586]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112734__236.json60.0missing{\n "num_gpu": 99\n}missing
2945Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_112854__17810.079.00731[313, 426]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112854__178.json60.0missing{\n "num_gpu": 99\n}missing
2946Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_113035__65600.0101.5560[313, 557]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_113035__656.json25.0missing{\n "num_gpu": 99\n}missing
2947Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_150034__58800.0123.3061[313, 679]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_150034__588.json55.0missing{\n "num_gpu": 99\n}missing
2948Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_150253__14210.0138.9561[313, 767]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_150253__142.json60.0missing{\n "num_gpu": 99\n}missing
2949Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_114041__40200.033.2490[436, 132]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114041__402.json0.0missing{\n "num_gpu": 99\n}missing
2950Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_114239__44510.0118.5981[436, 627]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114239__445.json60.0missing{\n "num_gpu": 99\n}missing
2951Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_114428__89610.0108.7131[436, 571]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114428__896.json60.0missing{\n "num_gpu": 99\n}missing
2952Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_151151__13110.086.91611[436, 444]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_151151__131.json60.0missing{\n "num_gpu": 99\n}missing
2953Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_151312__19240.080.03275[436, 404]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_151312__192.json95.0missing{\n "num_gpu": 99\n}missing
2954Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_113821__13000.0118.7490[434, 628]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_113821__130.json25.0missing{\n "num_gpu": 99\n}missing
2955Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_113923__60640.061.89815[434, 301]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_113923__606.json95.0missing{\n "num_gpu": 99\n}missing
2956Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_114008__72510.043.84811[434, 195]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_114008__725.json60.0missing{\n "num_gpu": 99\n}missing
2957Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_151024__56200.044.20580[434, 195]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_151024__562.json50.0missing{\n "num_gpu": 99\n}missing
2958Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_233603__62800.015.83160[1, 477]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_233603__628.json25.0missingmissingmissing
2959Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_233624__72700.021.27820[1, 625]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_233624__727.json0.0missingmissingmissing
2960Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_180826__12010.018.14241[128, 450]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_180826__120.json60.0missing{\n "num_gpu": 99\n}missing
2961Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_180842__17910.015.51971[128, 383]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_180842__179.json60.0missing{\n "num_gpu": 99\n}missing
2962Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_001122__71600.012.10050[128, 296]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_001122__716.json50.0missing{\n "num_gpu": 99\n}missing
2963Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_233519__80300.010.75590[1, 328]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_233519__803.json0.0missingmissingmissing
2964Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_233529__35600.010.03930[1, 307]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_233529__356.json0.0missingmissingmissing
2965Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180757__84800.09.850690[169, 230]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180757__848.json50.0missing{\n "num_gpu": 99\n}missing
2966Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180808__64000.010.91630[169, 257]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180808__640.json50.0missing{\n "num_gpu": 99\n}missing
2967Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_001110__57100.08.856530[169, 204]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_001110__571.json50.0missing{\n "num_gpu": 99\n}missing
2968Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_233441__73300.018.88360[1, 530]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_233441__733.json25.0missingmissingmissing
2969Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_233456__28600.014.81990[1, 423]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_233456__286.json0.0missingmissingmissing
2970Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_180729__19300.024.86180[316, 425]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180729__193.json50.0missing{\n "num_gpu": 99\n}missing
2971Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_180747__26100.017.05230[316, 389]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180747__261.json50.0missing{\n "num_gpu": 99\n}missing
2972Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_001101__24000.029.2190[316, 540]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001101__240.json50.0missing{\n "num_gpu": 99\n}missing
2973Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_233905__39600.023.59680[1, 629]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233905__396.json25.0missingmissingmissing
2974Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_233937__74200.031.95010[1, 827]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233937__742.json25.0missingmissingmissing
2975Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_181009__87340.024.12065[436, 539]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181009__873.json95.0missing{\n "num_gpu": 99\n}missing
2976Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_181031__15700.020.89910[436, 459]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181031__157.json50.0missing{\n "num_gpu": 99\n}missing
2977Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_001233__12700.032.45170[436, 733]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001233__127.json50.0missing{\n "num_gpu": 99\n}missing
2978Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_233807__91900.027.69540[1, 728]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233807__919.json0.0missingmissingmissing
2979Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_233825__78800.018.20460[1, 496]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233825__788.json25.0missingmissingmissing
2980Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180933__95310.022.74271[434, 506]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180933__953.json60.0missing{\n "num_gpu": 99\n}missing
2981Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180945__16940.011.20365[434, 224]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180945__169.json95.0missing{\n "num_gpu": 99\n}missing
2982Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_001200__50400.038.16190[434, 865]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_001200__504.json50.0missing{\n "num_gpu": 99\n}missing
2983Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231214_004050__46410.018.2081[124, 518]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_004050__464.json60.0missingmissingmissing
2984Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_165506__86510.09.556821[126, 301]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_165506__865.json60.0missing{\n "num_gpu": 99\n}missing
2985Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_165519__27900.013.23020[126, 420]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_165519__279.json50.0missing{\n "num_gpu": 99\n}missing
2986Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231226_234315__81710.09.522481[126, 298]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_234315__817.json60.0missing{\n "num_gpu": 99\n}missing
2987Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_004031__80310.013.92041[153, 386]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_004031__803.json60.0missingmissingmissing
2988Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_165447__51510.013.24251[167, 409]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_165447__515.json60.0missing{\n "num_gpu": 99\n}missing
2989Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_165456__35510.07.833311[167, 234]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_165456__355.json60.0missing{\n "num_gpu": 99\n}missing
2990Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_234306__42010.011.48011[167, 351]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_234306__420.json60.0missing{\n "num_gpu": 99\n}missing
2991Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_004017__32100.019.19330[300, 470]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004017__321.json25.0missingmissingmissing
2992Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_165418__32100.020.59971[314, 454]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165418__321.json55.0missing{\n "num_gpu": 99\n}missing
2993Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_165434__92510.015.96581[314, 470]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165434__925.json60.0missing{\n "num_gpu": 99\n}missing
2994Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_234254__53140.017.77565[314, 369]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234254__531.json95.0missing{\n "num_gpu": 99\n}missing
2995Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231214_004152__45110.023.1061[11, 611]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004152__451.json60.0missingmissingmissing
2996Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_165633__75310.018.17811[434, 512]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165633__753.json60.0missing{\n "num_gpu": 99\n}missing
2997Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_165645__97800.011.68720[434, 312]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165645__978.json50.0missing{\n "num_gpu": 99\n}missing
2998Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231226_234352__34110.023.89491[434, 679]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234352__341.json60.0missing{\n "num_gpu": 99\n}missing
2999Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231214_004129__50900.021.84590[424, 483]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_004129__509.json0.0missingmissingmissing
3000Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_165557__81510.015.18811[432, 419]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_165557__815.json60.0missing{\n "num_gpu": 99\n}missing
3001Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_165615__75700.017.41340[432, 489]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_165615__757.json50.0missing{\n "num_gpu": 99\n}missing
3002Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_234328__12510.012.43091[432, 333]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_234328__125.json60.0missing{\n "num_gpu": 99\n}missing
3003Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTtruetrue520231214_005415__85410.016.67291[124, 476]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231214_005415__854.json60.0missingmissingmissing
3004Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTfalsefalse520231225_172843__31000.02.660470[127, 31]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231225_172843__310.json0.0missing{\n "num_gpu": 99\n}missing
3005Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTfalsefalse520231225_172846__82300.02.984910[127, 37]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231225_172846__823.json0.0missing{\n "num_gpu": 99\n}missing
3006Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTfalsefalse520231226_235520__19600.02.862390[127, 35]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231226_235520__196.json0.0missing{\n "num_gpu": 99\n}missing
3007Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_005358__99900.012.11321[153, 335]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_005358__999.json55.0missingmissingmissing
3008Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_172825__25900.06.556950[166, 95]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_172825__259.json0.0missing{\n "num_gpu": 99\n}missing
3009Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTtruetrue520231225_172840__14500.014.94240[166, 251]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_172840__145.json50.0missing{\n "num_gpu": 99\n}missing
3010Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_235517__68900.021.17460[166, 367]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_235517__689.json0.0missing{\n "num_gpu": 99\n}missing
3011Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231214_005346__57600.017.1730[300, 417]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005346__576.json0.0missingmissingmissing
3012Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_172744__44400.066.05610[313, 899]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172744__444.json50.0missing{\n "num_gpu": 99\n}missing
3013Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_172819__25000.034.24860[313, 559]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172819__250.json0.0missing{\n "num_gpu": 99\n}missing
3014Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_235456__41500.034.0750[313, 410]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235456__415.json0.0missing{\n "num_gpu": 99\n}missing
3015Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231214_005520__63300.018.64670[11, 500]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005520__633.json0.0missingmissingmissing
3016Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_173147__89800.058.58850[430, 927]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_173147__898.json0.0missing{\n "num_gpu": 99\n}missing
3017Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_173304__85400.076.95580[430, 1201]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_173304__854.json50.0missing{\n "num_gpu": 99\n}missing
3018Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231226_235535__37600.07.856530[430, 79]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235535__376.json0.0missing{\n "num_gpu": 99\n}missing
3019Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTtruefalse520231214_005502__81400.030.1960[424, 689]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_005502__814.json25.0missingmissingmissing
3020Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTtruetrue520231225_173005__83000.070.16010[427, 1092]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_173005__830.json50.0missing{\n "num_gpu": 99\n}missing
3021Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTtruetrue520231225_173048__55100.043.68860[427, 691]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_173048__551.json50.0missing{\n "num_gpu": 99\n}missing
3022Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_235527__77600.07.471770[427, 72]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_235527__776.json0.0missing{\n "num_gpu": 99\n}missing
3023Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_234156__95000.018.99720[1, 564]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_234156__950.json25.0missingmissingmissing
3024Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_234216__69800.019.40420[1, 575]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_234216__698.json25.0missingmissingmissing
3025Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_181104__34300.05.258840[115, 196]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_181104__343.json0.0missing{\n "num_gpu": 99\n}missing
3026Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_181123__43400.019.20870[115, 713]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_181123__434.json0.0missing{\n "num_gpu": 99\n}missing
3027Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_001306__88600.022.34780[115, 821]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_001306__886.json0.0missing{\n "num_gpu": 99\n}missing
3028Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_234106__56300.011.58960[1, 352]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_234106__563.json0.0missingmissingmissing
3029Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231219_234116__95300.010.10560[1, 309]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_234116__953.json25.0missingmissingmissing
3030Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_181047__94200.04.612340[152, 166]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_181047__942.json0.0missing{\n "num_gpu": 99\n}missing
3031Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231225_181058__71110.010.96371[152, 409]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_181058__711.json60.0missing{\n "num_gpu": 99\n}missing
3032Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_001244__92600.06.506010[152, 239]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_001244__926.json0.0missing{\n "num_gpu": 99\n}missing
3033Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_234009__50600.018.33730[1, 516]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234009__506.json25.0missingmissingmissing
3034Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_234036__11900.027.44050[1, 745]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234036__119.json25.0missingmissingmissing
3035Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_181036__15900.04.796230[270, 3]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181036__159.json0.0missing{\n "num_gpu": 99\n}missing
3036Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_181043__79800.06.729110[270, 227]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181043__798.json0.0missing{\n "num_gpu": 99\n}missing
3037Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_001238__36000.04.446130[270, 5]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001238__360.json0.0missing{\n "num_gpu": 99\n}missing
3038Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_234513__36400.025.99230[1, 687]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234513__364.json25.0missingmissingmissing
3039Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_234539__40100.026.41960[1, 697]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234539__401.json25.0missingmissingmissing
3040Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_181256__98200.017.83930[404, 594]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181256__982.json0.0missing{\n "num_gpu": 99\n}missing
3041Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_181308__20800.011.94650[404, 390]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181308__208.json0.0missing{\n "num_gpu": 99\n}missing
3042Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_001329__78000.09.536480[404, 304]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001329__780.json0.0missing{\n "num_gpu": 99\n}missing
3043Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_234415__64600.032.07530[1, 831]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_234415__646.json0.0missingmissingmissing
3044Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_234433__68200.017.85640[1, 487]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_234433__682.json0.0missingmissingmissing
3045Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_181223__23100.012.52730[401, 411]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_181223__231.json0.0missing{\n "num_gpu": 99\n}missing
3046Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_181238__19500.015.57570[401, 517]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_181238__195.json0.0missing{\n "num_gpu": 99\n}missing
3047Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_001320__31400.013.1650[401, 432]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_001320__314.json0.0missing{\n "num_gpu": 99\n}missing
3048Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruetrue520231214_005610__11710.018.89311[124, 537]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_005610__117.json60.0missingmissingmissing
3049Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_173720__37400.039.3860[135, 294]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_173720__374.json50.0missing{\n "num_gpu": 99\n}missing
3050Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruefalse520231225_173817__97200.057.19320[135, 436]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_173817__972.json25.0missing{\n "num_gpu": 99\n}missing
3051Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruefalse520231226_235827__86900.031.04590[135, 225]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_235827__869.json25.0missing{\n "num_gpu": 99\n}missing
3052Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_005550__65910.013.47891[153, 374]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_005550__659.json60.0missingmissingmissing
3053Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_173547__95410.056.85081[174, 412]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_173547__954.json60.0missing{\n "num_gpu": 99\n}missing
3054Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruefalse520231225_173641__97100.052.56650[174, 392]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_173641__971.json25.0missing{\n "num_gpu": 99\n}missing
3055Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_235755__18120.051.56635[174, 381]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_235755__181.json85.0missing{\n "num_gpu": 99\n}missing
3056Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231214_005537__43510.016.33691[300, 394]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005537__435.json60.0missingmissingmissing
3057Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_173420__72530.076.01865[321, 357]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_173420__725.json90.0missing{\n "num_gpu": 99\n}missing
3058Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231225_173451__12700.029.9690[321, 178]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_173451__127.json25.0missing{\n "num_gpu": 99\n}missing
3059Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231226_235704__83100.088.39070[321, 476]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235704__831.json25.0missing{\n "num_gpu": 99\n}missing
3060Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_005717__11800.022.43060[11, 593]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005717__118.json0.0missingmissingmissing
3061Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231225_174240__60000.056.51990[438, 372]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_174240__600.json25.0missing{\n "num_gpu": 99\n}missing
3062Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_174328__87010.048.75371[438, 312]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_174328__870.json60.0missing{\n "num_gpu": 99\n}missing
3063Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231226_235906__72600.09.693170[438, 5]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235906__726.json0.0missing{\n "num_gpu": 99\n}missing
3064Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse520231214_005655__75100.022.5420[424, 499]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_005655__751.json0.0missingmissingmissing
3065Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_174046__71910.042.64735[435, 265]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_174046__719.json80.0missing{\n "num_gpu": 99\n}missing
3066Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231225_174143__81900.056.39740[435, 371]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_174143__819.json25.0missing{\n "num_gpu": 99\n}missing
3067Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231226_235856__79000.029.11370[435, 159]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_235856__790.json25.0missing{\n "num_gpu": 99\n}missing
3068Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_232336__24000.015.45430[1, 466]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_232336__240.json25.0missingmissingmissing
3069Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_232351__64300.015.18440[1, 459]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_232351__643.json0.0missingmissingmissing
3070Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_180010__27100.030.51555[128, 511]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_180010__271.json75.0missing{\n "num_gpu": 99\n}missing
3071Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_180109__43400.058.51875[128, 967]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_180109__434.json75.0missing{\n "num_gpu": 99\n}missing
3072Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_000724__98310.024.35581[128, 404]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_000724__983.json60.0missing{\n "num_gpu": 99\n}missing
3073Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_232250__28600.07.989630[1, 247]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232250__286.json0.0missingmissingmissing
3074Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_232304__74000.013.56680[1, 408]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232304__740.json25.0missingmissingmissing
3075Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_175928__37610.010.30575[169, 155]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_175928__376.json80.0missing{\n "num_gpu": 99\n}missing
3076Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_175940__13810.011.51811[169, 176]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_175940__138.json60.0missing{\n "num_gpu": 99\n}missing
3077Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_000659__33210.011.44721[169, 175]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_000659__332.json60.0missing{\n "num_gpu": 99\n}missing
3078Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_232211__21200.014.58910[1, 417]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232211__212.json0.0missingmissingmissing
3079Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_232228__18000.017.70350[1, 499]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232228__180.json25.0missingmissingmissing
3080Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_175849__79800.037.79770[316, 451]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_175849__798.json0.0missing{\n "num_gpu": 99\n}missing
3081Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_175917__93900.028.52440[316, 443]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_175917__939.json25.0missing{\n "num_gpu": 99\n}missing
3082Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_000647__39800.035.91590[316, 422]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_000647__398.json0.0missing{\n "num_gpu": 99\n}missing
3083Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_232703__11800.013.30890[1, 369]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232703__118.json0.0missingmissingmissing
3084Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_232736__87100.033.13670[1, 854]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232736__871.json25.0missingmissingmissing
3085Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180317__92410.026.42951[436, 386]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180317__924.json60.0missing{\n "num_gpu": 99\n}missing
3086Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180339__29910.022.09691[436, 315]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180339__299.json60.0missing{\n "num_gpu": 99\n}missing
3087Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_000823__38310.029.00121[436, 428]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_000823__383.json60.0missing{\n "num_gpu": 99\n}missing
3088Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_232555__13500.025.69160[1, 680]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232555__135.json0.0missingmissingmissing
3089Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_232629__96100.034.00130[1, 875]0.5.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232629__961.json25.0missingmissingmissing
3090Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180218__94610.022.51021[434, 322]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180218__946.json60.0missing{\n "num_gpu": 99\n}missing
3091Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180250__96710.031.55111[434, 470]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180250__967.json60.0missing{\n "num_gpu": 99\n}missing
3092Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_000754__77710.029.351[434, 434]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_000754__777.json60.0missing{\n "num_gpu": 99\n}missing
3093Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTtruetrue520231214_005220__52400.012.97221[124, 371]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_005220__524.json55.0missingmissingmissing
3094Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTfalsefalse520231225_172521__63300.017.71030[126, 904]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_172521__633.json0.0missing{\n "num_gpu": 99\n}missing
3095Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTfalsefalse520231225_172528__39100.07.042110[126, 384]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_172528__391.json0.0missing{\n "num_gpu": 99\n}missing
3096Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTtruefalse520231226_235401__97900.09.678950[126, 528]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_235401__979.json25.0missing{\n "num_gpu": 99\n}missing
3097Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_005207__32910.017.91011[153, 498]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_005207__329.json60.0missingmissingmissing
3098Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_172454__89900.07.026960[163, 359]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_172454__899.json0.0missing{\n "num_gpu": 99\n}missing
3099Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_172503__39000.08.72920[163, 446]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_172503__390.json0.0missing{\n "num_gpu": 99\n}missing
3100Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231226_235351__63800.08.561180[163, 456]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_235351__638.json0.0missing{\n "num_gpu": 99\n}missing
3101Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231214_005149__24100.024.92430[300, 618]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005149__241.json25.0missingmissingmissing
3102Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_172440__49000.014.42750[278, 571]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172440__490.json0.0missing{\n "num_gpu": 99\n}missing
3103Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_172447__97000.07.230430[278, 356]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172447__970.json0.0missing{\n "num_gpu": 99\n}missing
3104Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_235342__56900.010.03530[278, 365]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235342__569.json0.0missing{\n "num_gpu": 99\n}missing
3105Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_005329__72200.023.73510[11, 626]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005329__722.json0.0missingmissingmissing
3106Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_172625__86610.010.91921[413, 487]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172625__866.json60.0missing{\n "num_gpu": 99\n}missing
3107Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_172638__55200.012.920[413, 591]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172638__552.json0.0missing{\n "num_gpu": 99\n}missing
3108Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_235422__68410.012.82381[413, 592]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235422__684.json60.0missing{\n "num_gpu": 99\n}missing
3109Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231214_005305__63000.025.79980[424, 582]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_005305__630.json0.0missingmissingmissing
3110Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_172557__13700.017.88890[411, 797]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_172557__137.json50.0missing{\n "num_gpu": 99\n}missing
3111Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_172614__68900.016.74610[411, 755]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_172614__689.json0.0missing{\n "num_gpu": 99\n}missing
3112Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231226_235409__18800.08.307750[411, 375]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_235409__188.json25.0missing{\n "num_gpu": 99\n}missing
3113Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruefalse520231214_004235__58100.015.3220[124, 438]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_004235__581.json25.0missingmissingmissing
3114Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruetrue520231225_165806__66210.016.25061[128, 516]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_165806__662.json60.0missing{\n "num_gpu": 99\n}missing
3115Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruetrue520231225_165820__52000.013.67830[128, 433]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_165820__520.json50.0missing{\n "num_gpu": 99\n}missing
3116Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruetrue520231226_234439__14510.012.6051[128, 398]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_234439__145.json60.0missing{\n "num_gpu": 99\n}missing
3117Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_004219__75710.012.471[153, 345]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_004219__757.json60.0missingmissingmissing
3118Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231225_165734__47900.010.43420[169, 318]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_165734__479.json0.0missing{\n "num_gpu": 99\n}missing
3119Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_165749__34210.015.01291[169, 464]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_165749__342.json60.0missing{\n "num_gpu": 99\n}missing
3120Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_234426__46610.010.95111[169, 334]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_234426__466.json60.0missing{\n "num_gpu": 99\n}missing
3121Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231214_004207__69900.014.26140[300, 338]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004207__699.json25.0missingmissingmissing
3122Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231225_165705__18700.020.47890[316, 442]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165705__187.json25.0missing{\n "num_gpu": 99\n}missing
3123Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231225_165724__41900.018.33470[316, 542]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165724__419.json25.0missing{\n "num_gpu": 99\n}missing
3124Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231226_234415__18800.022.96060[316, 522]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234415__188.json25.0missing{\n "num_gpu": 99\n}missing
3125Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231214_004340__48430.021.09815[11, 561]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004340__484.json90.0missingmissingmissing
3126Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_165925__83500.011.3420[436, 300]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165925__835.json50.0missing{\n "num_gpu": 99\n}missing
3127Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_165953__83000.028.19291[436, 807]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165953__830.json55.0missing{\n "num_gpu": 99\n}missing
3128Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_234508__42210.016.50191[436, 457]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234508__422.json60.0missing{\n "num_gpu": 99\n}missing
3129Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231214_004318__62700.022.41850[424, 497]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_004318__627.json0.0missingmissingmissing
3130Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231225_165905__59500.022.68020[434, 645]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_165905__595.json25.0missing{\n "num_gpu": 99\n}missing
3131Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_165913__77100.08.443531[434, 208]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_165913__771.json55.0missing{\n "num_gpu": 99\n}missing
3132Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_234452__74710.012.55691[434, 336]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_234452__747.json60.0missing{\n "num_gpu": 99\n}missing
3133Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruetrue520231214_004429__41210.019.9041[124, 564]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_004429__412.json60.0missingmissingmissing
3134Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruetrue520231225_170458__55200.079.6450[123, 594]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_170458__552.json50.0missing{\n "num_gpu": 99\n}missing
3135Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruefalse520231225_170601__54800.063.33820[123, 468]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_170601__548.json25.0missing{\n "num_gpu": 99\n}missing
3136Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruefalse520231226_234907__46900.0100.9920[123, 748]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_234907__469.json25.0missing{\n "num_gpu": 99\n}missing
3137Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_004409__67910.09.866231[153, 269]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_004409__679.json60.0missingmissingmissing
3138Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_170243__64910.041.67041[162, 296]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_170243__649.json60.0missing{\n "num_gpu": 99\n}missing
3139Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_170338__43900.053.60460[162, 387]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_170338__439.json25.0missing{\n "num_gpu": 99\n}missing
3140Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_234726__46500.040.10880[162, 283]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_234726__465.json50.0missing{\n "num_gpu": 99\n}missing
3141Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231214_004358__96900.018.71590[300, 457]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004358__969.json25.0missingmissingmissing
3142Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_170100__81810.066.61791[313, 280]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_170100__818.json60.0missing{\n "num_gpu": 99\n}missing
3143Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_170202__34600.061.03140[313, 415]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_170202__346.json25.0missing{\n "num_gpu": 99\n}missing
3144Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231226_234646__68200.097.38720[313, 516]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234646__682.json25.0missing{\n "num_gpu": 99\n}missing
3145Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_004536__18710.019.66261[11, 525]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004536__187.json60.0missingmissingmissing
3146Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_171229__90800.085.79120[436, 568]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171229__908.json50.0missing{\n "num_gpu": 99\n}missing
3147Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231225_171238__68000.09.691640[436, 4]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171238__680.json0.0missing{\n "num_gpu": 99\n}missing
3148Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231226_235029__20400.016.74110[436, 58]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235029__204.json0.0missing{\n "num_gpu": 99\n}missing
3149Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTfalsefalse520231214_004516__99300.026.39580[424, 597]0.4.051.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_004516__993.json0.0missingmissingmissing
3150Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_170951__78600.0102.1850[434, 684]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_170951__786.json25.0missing{\n "num_gpu": 99\n}missing
3151Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_171103__56500.071.47980[434, 465]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_171103__565.json25.0missing{\n "num_gpu": 99\n}missing
3152Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_235012__99100.063.9850[434, 410]0.6.051.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_235012__991.json50.0missing{\n "num_gpu": 99\n}missing
3153Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTtruetrue520231214_010913__67400.067.72510[89, 548]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_010913__674.json50.0missingmissingmissing
3154Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTtruetrue520231225_142511__73200.023.3151[97, 423]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_142511__732.json56.25missing{\n "num_gpu": 99\n}missing
3155Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTfalsefalse520231225_142517__95000.06.38990[97, 104]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_142517__950.json0.0missing{\n "num_gpu": 99\n}missing
3156Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTtruetrue520231227_002344__28420.05.809493[97, 92]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_002344__284.json78.75missing{\n "num_gpu": 99\n}missing
3157Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231214_010805__24000.047.7980[118, 377]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_010805__240.json25.0missingmissingmissing
3158Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_142442__21700.014.88070[135, 260]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_142442__217.json50.0missing{\n "num_gpu": 99\n}missing
3159Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_142447__65600.05.025710[135, 72]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_142447__656.json0.0missing{\n "num_gpu": 99\n}missing
3160Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_002339__11830.06.113573[135, 93]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_002339__118.json83.75missing{\n "num_gpu": 99\n}missing
3161Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231214_010717__58700.065.15380[211, 509]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_010717__587.json50.0missingmissingmissing
3162Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_142413__16700.025.20163[229, 253]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142413__167.json68.75missing{\n "num_gpu": 99\n}missing
3163Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_142427__66010.014.56921[229, 236]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142427__660.json61.25missing{\n "num_gpu": 99\n}missing
3164Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_002332__86500.024.81743[229, 252]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002332__865.json68.75missing{\n "num_gpu": 99\n}missing
3165Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_011155__64100.060.49120[11, 467]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_011155__641.json50.0missingmissingmissing
3166Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_142631__76920.016.54862[400, 242]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142631__769.json72.5missing{\n "num_gpu": 99\n}missing
3167Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_142649__48720.018.03843[400, 269]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142649__487.json78.75missing{\n "num_gpu": 99\n}missing
3168Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231227_002426__77600.016.970[400, 245]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002426__776.json25.0missing{\n "num_gpu": 99\n}missing
3169Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_011055__71200.064.15340[389, 404]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_011055__712.json0.0missingmissingmissing
3170Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_142558__83810.022.23022[397, 344]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_142558__838.json67.5missing{\n "num_gpu": 99\n}missing
3171Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_142614__30800.016.55940[397, 243]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_142614__308.json50.0missing{\n "num_gpu": 99\n}missing
3172Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_002408__25400.023.12660[397, 358]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_002408__254.json50.0missing{\n "num_gpu": 99\n}missing
3173Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonInJulia1SHOTtruetrue520231214_011400__81900.053.65480[89, 451]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_011400__819.json50.0missingmissingmissing
3174Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonInJulia1SHOTfalsefalse520231225_142804__56600.01.564770[71, 15]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_142804__566.json0.0missing{\n "num_gpu": 99\n}missing
3175Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonInJulia1SHOTtruetrue520231225_142813__39100.08.786280[71, 155]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_142813__391.json50.0missing{\n "num_gpu": 99\n}missing
3176Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_011307__95900.020.1570[118, 167]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_011307__959.json0.0missingmissingmissing
3177Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231225_142740__62200.027.4330[72, 504]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_142740__622.json50.0missing{\n "num_gpu": 99\n}missing
3178Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231225_142802__15800.021.67670[72, 399]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_142802__158.json50.0missing{\n "num_gpu": 99\n}missing
3179Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_011246__43000.051.04050[211, 406]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_011246__430.json50.0missingmissingmissing
3180Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231225_142705__96200.015.55590[104, 88]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142705__962.json50.0missing{\n "num_gpu": 99\n}missing
3181Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_142713__19400.07.958930[104, 134]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142713__194.json0.0missing{\n "num_gpu": 99\n}missing
3182Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231214_072324__71200.010.38020[11, 61]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_072324__712.json0.0missingmissingmissing
3183Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_142911__22300.012.47440[89, 225]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142911__223.json0.0missing{\n "num_gpu": 99\n}missing
3184Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_142912__46300.01.373460[89, 11]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142912__463.json0.0missing{\n "num_gpu": 99\n}missing
3185Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_072313__14500.0109.1140[389, 538]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_072313__145.json0.0missingmissingmissing
3186Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231225_142841__17500.09.802120[86, 174]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_142841__175.json50.0missing{\n "num_gpu": 99\n}missing
3187Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_142858__69200.016.63490[86, 304]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_142858__692.json25.0missing{\n "num_gpu": 99\n}missing
3188Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_234655__12500.010.68740[1, 334]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_234655__125.json25.0missingmissingmissing
3189Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_234708__15600.012.05750[1, 374]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_234708__156.json25.0missingmissingmissing
3190Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_144900__23120.045.43292[90, 273]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_144900__231.json72.5missing{\n "num_gpu": 99\n}missing
3191Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_144932__86220.030.72552[90, 177]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_144932__862.json72.5missing{\n "num_gpu": 99\n}missing
3192Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_003537__64700.043.3823[90, 257]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_003537__647.json68.75missing{\n "num_gpu": 99\n}missing
3193Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_234623__11400.02.240220[1, 72]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_234623__114.json25.0missingmissingmissing
3194Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_234632__48400.08.79940[1, 274]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_234632__484.json25.0missingmissingmissing
3195Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_144724__47520.071.51432[131, 424]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_144724__475.json72.5missing{\n "num_gpu": 99\n}missing
3196Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_144815__75100.049.88380[131, 291]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_144815__751.json50.0missing{\n "num_gpu": 99\n}missing
3197Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_003453__64100.0140.3340[131, 810]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_003453__641.json50.0missing{\n "num_gpu": 99\n}missing
3198Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_234607__69600.04.358720[1, 134]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234607__696.json0.0missingmissingmissing
3199Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_234613__53600.05.984660[1, 183]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234613__536.json0.0missingmissingmissing
3200Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_144536__79500.057.07534[224, 161]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_144536__795.json75.0missing{\n "num_gpu": 99\n}missing
3201Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_144612__85510.036.08453[224, 193]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_144612__855.json73.75missing{\n "num_gpu": 99\n}missing
3202Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_003233__64800.044.86470[224, 97]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_003233__648.json0.0missing{\n "num_gpu": 99\n}missing
3203Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_234852__27400.020.42520[1, 557]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234852__274.json0.0missingmissingmissing
3204Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_234914__49100.022.08670[1, 598]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234914__491.json25.0missingmissingmissing
3205Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145305__69110.074.00364[419, 385]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145305__691.json80.0missing{\n "num_gpu": 99\n}missing
3206Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145349__15400.043.56321[419, 202]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145349__154.json56.25missing{\n "num_gpu": 99\n}missing
3207Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_003731__36420.065.61174[419, 329]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003731__364.json85.0missing{\n "num_gpu": 99\n}missing
3208Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_234817__53800.01.222610[1, 36]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_234817__538.json0.0missingmissingmissing
3209Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_234829__10500.011.98020[1, 338]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_234829__105.json25.0missingmissingmissing
3210Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145129__67350.033.29354[417, 140]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145129__673.json100.0missing{\n "num_gpu": 99\n}missing
3211Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145150__89220.020.80683[417, 63]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145150__892.json78.75missing{\n "num_gpu": 99\n}missing
3212Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_003625__31320.047.39124[417, 225]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_003625__313.json85.0missing{\n "num_gpu": 99\n}missing
3213Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_004318__97100.012.97470[89, 494]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_004318__971.json0.0missing{\n "num_gpu": 99\n}missing
3214Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_114514__28200.010.17740[89, 390]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_114514__282.json0.0missing{\n "num_gpu": 99\n}missing
3215Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_114528__20900.014.34810[89, 544]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_114528__209.json0.0missing{\n "num_gpu": 99\n}missing
3216Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_114541__75700.012.69670[89, 484]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_114541__757.json25.0missing{\n "num_gpu": 99\n}missing
3217Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_004305__87300.03.260130[126, 117]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_004305__873.json0.0missing{\n "num_gpu": 99\n}missing
3218Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_114450__99300.05.016290[126, 186]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_114450__993.json0.0missing{\n "num_gpu": 99\n}missing
3219Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_114456__50800.05.932230[126, 222]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_114456__508.json0.0missing{\n "num_gpu": 99\n}missing
3220Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_114503__28800.07.125820[126, 268]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_114503__288.json0.0missing{\n "num_gpu": 99\n}missing
3221Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_004302__54900.05.460640[217, 58]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004302__549.json25.0missing{\n "num_gpu": 99\n}missing
3222Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_114437__14600.07.8380[217, 146]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114437__146.json0.0missing{\n "num_gpu": 99\n}missing
3223Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_114442__48200.05.424680[217, 187]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114442__482.json50.0missing{\n "num_gpu": 99\n}missing
3224Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_114445__88200.03.199490[217, 101]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114445__882.json50.0missing{\n "num_gpu": 99\n}missing
3225Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_004331__11600.07.031820[378, 219]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004331__116.json0.0missing{\n "num_gpu": 99\n}missing
3226Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_114621__29000.08.3970[378, 269]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114621__290.json0.0missing{\n "num_gpu": 99\n}missing
3227Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_114628__93600.06.573760[378, 202]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114628__936.json50.0missing{\n "num_gpu": 99\n}missing
3228Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_114638__37400.09.704750[378, 316]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114638__374.json0.0missing{\n "num_gpu": 99\n}missing
3229Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_004324__75000.05.654240[375, 168]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_004324__750.json0.0missing{\n "num_gpu": 99\n}missing
3230Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_114551__41800.09.97770[375, 326]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_114551__418.json50.0missing{\n "num_gpu": 99\n}missing
3231Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_114600__15700.09.196910[375, 298]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_114600__157.json0.0missing{\n "num_gpu": 99\n}missing
3232Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_114613__59800.012.94810[375, 432]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_114613__598.json0.0missing{\n "num_gpu": 99\n}missing
3233Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTtruefalse520231214_005750__94800.016.29950[89, 476]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231214_005750__948.json25.0missingmissingmissing
3234Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTtruefalse520231225_140722__17100.018.31630[89, 536]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231225_140722__171.json25.0missing{\n "num_gpu": 99\n}missing
3235Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTtruefalse520231225_140735__89500.012.70060[1, 393]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231225_140735__895.json25.0missing{\n "num_gpu": 99\n}missing
3236Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTtruefalse520231227_001712__11300.020.60410[89, 605]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231227_001712__113.json25.0missing{\n "num_gpu": 99\n}missing
3237Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTtruetrue520231214_005733__28200.03.286080[118, 78]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_005733__282.json50.0missingmissingmissing
3238Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTfalsefalse520231225_140659__61000.010.56390[118, 303]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_140659__610.json0.0missing{\n "num_gpu": 99\n}missing
3239Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTtruetrue520231225_140703__49900.03.988420[1, 127]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_140703__499.json50.0missing{\n "num_gpu": 99\n}missing
3240Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTtruetrue520231227_001651__32700.010.02470[118, 290]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_001651__327.json50.0missing{\n "num_gpu": 99\n}missing
3241Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruefalse520231214_005730__64400.012.90240[211, 336]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005730__644.json25.0missingmissingmissing
3242Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruetrue520231225_140639__12610.028.20021[229, 611]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140639__126.json61.25missing{\n "num_gpu": 99\n}missing
3243Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruetrue520231225_140649__60200.09.805330[1, 294]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140649__602.json50.0missing{\n "num_gpu": 99\n}missing
3244Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruetrue520231227_001641__34000.014.73870[229, 250]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001641__340.json50.0missing{\n "num_gpu": 99\n}missing
3245Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTtruefalse520231214_005836__47400.023.17750[11, 616]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005836__474.json25.0missingmissingmissing
3246Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTtruetrue520231225_140847__66300.015.29450[11, 420]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140847__663.json50.0missing{\n "num_gpu": 99\n}missing
3247Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTfalsefalse520231225_140849__10300.01.972690[1, 57]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140849__103.json0.0missing{\n "num_gpu": 99\n}missing
3248Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTtruefalse520231227_001746__97100.021.9140[11, 595]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001746__971.json25.0missing{\n "num_gpu": 99\n}missing
3249Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTfalsefalse520231214_005813__24600.013.14950[389, 270]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_005813__246.json0.0missingmissingmissing
3250Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTfalsefalse520231225_140802__17100.04.851010[389, 36]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_140802__171.json0.0missing{\n "num_gpu": 99\n}missing
3251Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTtruetrue520231225_140831__17900.029.37980[1, 776]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_140831__179.json50.0missing{\n "num_gpu": 99\n}missing
3252Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTfalsefalse520231227_001724__13400.012.25190[389, 250]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_001724__134.json0.0missing{\n "num_gpu": 99\n}missing
3253Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231214_072654__47800.048.69110[89, 373]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231214_072654__478.json50.0missingmissingmissing
3254Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231225_143003__36620.09.816182[89, 323]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231225_143003__366.json72.5missing{\n "num_gpu": 99\n}missing
3255Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231225_143012__93920.09.084714[89, 297]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231225_143012__939.json85.0missing{\n "num_gpu": 99\n}missing
3256Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231227_002458__61720.08.709724[89, 283]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231227_002458__617.json85.0missing{\n "num_gpu": 99\n}missing
3257Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTfalsefalse520231214_072605__94900.055.15430[118, 420]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_072605__949.json0.0missingmissingmissing
3258Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTtruetrue520231225_142942__71200.07.410920[128, 236]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_142942__712.json50.0missing{\n "num_gpu": 99\n}missing
3259Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTfalsefalse520231225_142953__70200.010.35980[128, 334]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_142953__702.json0.0missing{\n "num_gpu": 99\n}missing
3260Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTtruetrue520231227_002450__71500.09.901970[128, 317]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_002450__715.json50.0missing{\n "num_gpu": 99\n}missing
3261Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruetrue520231214_072510__55110.0106.2532[211, 622]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_072510__551.json67.5missingmissingmissing
3262Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_142928__15400.016.07490[221, 308]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142928__154.json50.0missing{\n "num_gpu": 99\n}missing
3263Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruefalse520231225_142935__87400.06.708340[221, 194]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142935__874.json25.0missing{\n "num_gpu": 99\n}missing
3264Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruefalse520231227_002440__34800.013.53330[221, 229]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002440__348.json25.0missing{\n "num_gpu": 99\n}missing
3265Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_072804__46100.015.9150[11, 435]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_072804__461.json50.0missingmissingmissing
3266Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_143103__72710.05.501031[392, 124]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143103__727.json61.25missing{\n "num_gpu": 99\n}missing
3267Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_143118__28220.014.46013[392, 410]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143118__282.json78.75missing{\n "num_gpu": 99\n}missing
3268Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruefalse520231227_002530__77000.013.8370[392, 388]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002530__770.json25.0missing{\n "num_gpu": 99\n}missing
3269Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruetrue520231214_072748__80100.030.41870[389, 712]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_072748__801.json50.0missingmissingmissing
3270Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruetrue520231225_143042__70520.012.54752[389, 351]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_143042__705.json72.5missing{\n "num_gpu": 99\n}missing
3271Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruefalse520231225_143057__17700.015.30[389, 436]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_143057__177.json25.0missing{\n "num_gpu": 99\n}missing
3272Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruetrue520231227_002516__84920.016.81364[389, 480]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_002516__849.json85.0missing{\n "num_gpu": 99\n}missing
3273Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KInJulia1SHOTfalsefalse520231227_180952__50700.017.4110[89, 337]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180952__507.json0.0missing{\n "num_gpu": 99\n}missing
3274Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180957__73600.05.676140[89, 104]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180957__736.json50.0missing{\n "num_gpu": 99\n}missing
3275Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181020__88920.023.1063[89, 448]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181020__889.json78.75missing{\n "num_gpu": 99\n}missing
3276Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180855__29900.011.69910[128, 220]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180855__299.json50.0missing{\n "num_gpu": 99\n}missing
3277Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_180916__17400.020.79130[128, 398]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180916__174.json25.0missing{\n "num_gpu": 99\n}missing
3278Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_180934__74200.018.23230[128, 349]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180934__742.json0.0missing{\n "num_gpu": 99\n}missing
3279Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180814__32400.011.95330[221, 213]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180814__324.json50.0missing{\n "num_gpu": 99\n}missing
3280Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180830__50800.015.66982[221, 286]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180830__508.json62.5missing{\n "num_gpu": 99\n}missing
3281Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180843__62500.012.85950[221, 231]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180843__625.json50.0missing{\n "num_gpu": 99\n}missing
3282Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181138__94500.015.75930[392, 264]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181138__945.json50.0missing{\n "num_gpu": 99\n}missing
3283Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181156__68950.017.54773[392, 298]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181156__689.json93.75missing{\n "num_gpu": 99\n}missing
3284Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181207__47210.010.7232[392, 167]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181207__472.json67.5missing{\n "num_gpu": 99\n}missing
3285Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181040__75220.019.63613[389, 338]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181040__752.json78.75missing{\n "num_gpu": 99\n}missing
3286Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181057__82700.016.96970[389, 287]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181057__827.json50.0missing{\n "num_gpu": 99\n}missing
3287Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181122__28540.024.26073[389, 425]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181122__285.json88.75missing{\n "num_gpu": 99\n}missing
3288Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231220_073949__97000.015.80770[1, 482]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231220_073949__970.json25.0missingmissingmissing
3289Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231220_074000__68000.010.21060[1, 320]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231220_074000__680.json25.0missingmissingmissing
3290Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_145800__76700.07.367940[88, 181]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_145800__767.json0.0missing{\n "num_gpu": 99\n}missing
3291Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_145808__47600.08.109710[88, 200]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_145808__476.json0.0missing{\n "num_gpu": 99\n}missing
3292Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231227_003945__72000.06.876290[88, 167]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_003945__720.json0.0missing{\n "num_gpu": 99\n}missing
3293Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_235349__82400.012.23040[118, 351]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_235349__824.json25.0missingmissingmissing
3294Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231220_073915__95100.010.67410[135, 299]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231220_073915__951.json25.0missingmissingmissing
3295Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_145745__91000.07.639090[129, 179]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145745__910.json50.0missing{\n "num_gpu": 99\n}missing
3296Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_145753__44200.07.448250[129, 174]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145753__442.json0.0missing{\n "num_gpu": 99\n}missing
3297Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_003938__57400.012.20660[129, 295]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_003938__574.json50.0missing{\n "num_gpu": 99\n}missing
3298Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_235325__75800.05.669950[1, 174]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_235325__758.json25.0missingmissingmissing
3299Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_235337__18300.012.22910[1, 363]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_235337__183.json25.0missingmissingmissing
3300Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_145732__57500.011.33290[223, 119]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145732__575.json0.0missing{\n "num_gpu": 99\n}missing
3301Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_145738__70300.06.173090[223, 130]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145738__703.json0.0missing{\n "num_gpu": 99\n}missing
3302Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_003925__22010.021.15891[223, 374]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_003925__220.json61.25missing{\n "num_gpu": 99\n}missing
3303Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145911__48220.014.99732[396, 325]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145911__482.json72.5missing{\n "num_gpu": 99\n}missing
3304Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145928__62100.016.95593[396, 373]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145928__621.json68.75missing{\n "num_gpu": 99\n}missing
3305Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_003959__63700.06.150090[396, 102]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003959__637.json0.0missing{\n "num_gpu": 99\n}missing
3306Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145837__69300.09.084080[394, 177]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145837__693.json50.0missing{\n "num_gpu": 99\n}missing
3307Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_145856__64100.018.62760[394, 414]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145856__641.json0.0missing{\n "num_gpu": 99\n}missing
3308Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_003953__87400.08.204220[394, 154]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_003953__874.json50.0missing{\n "num_gpu": 99\n}missing
3309Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_234122__82500.020.13590[87, 635]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234122__825.json0.0missing{\n "num_gpu": 99\n}missing
3310Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234133__90420.010.8834[87, 343]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234133__904.json85.0missing{\n "num_gpu": 99\n}missing
3311Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234141__16700.08.164040[87, 255]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234141__167.json50.0missing{\n "num_gpu": 99\n}missing
3312Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234151__39900.09.451790[87, 297]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234151__399.json50.0missing{\n "num_gpu": 99\n}missing
3313Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234201__72610.09.479054[87, 298]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234201__726.json80.0missing{\n "num_gpu": 99\n}missing
3314Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234038__99600.03.154590[128, 85]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234038__996.json0.0missing{\n "num_gpu": 99\n}missing
3315Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_234042__14800.04.385650[128, 126]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234042__148.json50.0missing{\n "num_gpu": 99\n}missing
3316Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234050__63000.07.932530[128, 242]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234050__630.json0.0missing{\n "num_gpu": 99\n}missing
3317Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234055__92200.04.9850[128, 146]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234055__922.json0.0missing{\n "num_gpu": 99\n}missing
3318Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234102__80100.06.534120[128, 196]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234102__801.json0.0missing{\n "num_gpu": 99\n}missing
3319Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_233948__52500.013.13580[222, 365]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233948__525.json0.0missing{\n "num_gpu": 99\n}missing
3320Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234004__84300.016.62480[222, 498]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234004__843.json50.0missing{\n "num_gpu": 99\n}missing
3321Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234015__35300.010.59630[222, 310]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234015__353.json50.0missing{\n "num_gpu": 99\n}missing
3322Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234025__46720.010.10184[222, 294]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234025__467.json85.0missing{\n "num_gpu": 99\n}missing
3323Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_234035__25500.09.554060[222, 277]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234035__255.json0.0missing{\n "num_gpu": 99\n}missing
3324Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234323__92000.010.60550[395, 277]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234323__920.json50.0missing{\n "num_gpu": 99\n}missing
3325Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234336__76800.012.90840[395, 348]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234336__768.json50.0missing{\n "num_gpu": 99\n}missing
3326Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234357__97100.021.08420[395, 594]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234357__971.json50.0missing{\n "num_gpu": 99\n}missing
3327Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234414__43800.017.06350[395, 474]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234414__438.json50.0missing{\n "num_gpu": 99\n}missing
3328Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234427__70500.012.4340[395, 333]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234427__705.json50.0missing{\n "num_gpu": 99\n}missing
3329Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234213__15600.012.03360[393, 321]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234213__156.json50.0missing{\n "num_gpu": 99\n}missing
3330Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234226__12900.012.66120[393, 340]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234226__129.json50.0missing{\n "num_gpu": 99\n}missing
3331Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234245__18200.019.03050[393, 533]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234245__182.json50.0missing{\n "num_gpu": 99\n}missing
3332Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234301__28200.015.35660[393, 422]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234301__282.json50.0missing{\n "num_gpu": 99\n}missing
3333Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_234312__55200.011.03970[393, 290]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234312__552.json0.0missing{\n "num_gpu": 99\n}missing
3334Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_234623__54500.010.39620[87, 257]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234623__545.json0.0missing{\n "num_gpu": 99\n}missing
3335Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_234631__55600.08.718720[87, 214]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234631__556.json50.0missing{\n "num_gpu": 99\n}missing
3336Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_234644__54200.012.19470[87, 303]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234644__542.json50.0missing{\n "num_gpu": 99\n}missing
3337Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_234649__52800.04.900840[87, 115]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234649__528.json25.0missing{\n "num_gpu": 99\n}missing
3338Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_234658__18600.09.49831[87, 234]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234658__186.json56.25missing{\n "num_gpu": 99\n}missing
3339Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_234530__78600.05.989350[128, 138]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234530__786.json0.0missing{\n "num_gpu": 99\n}missing
3340Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_234540__80700.010.28362[128, 249]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234540__807.json62.5missing{\n "num_gpu": 99\n}missing
3341Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_234554__50800.013.68424[128, 335]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234554__508.json75.0missing{\n "num_gpu": 99\n}missing
3342Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_234600__92600.04.790940[128, 107]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234600__926.json0.0missing{\n "num_gpu": 99\n}missing
3343Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_234612__54500.012.47950[128, 305]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234612__545.json50.0missing{\n "num_gpu": 99\n}missing
3344Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_234442__12600.014.98550[222, 331]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234442__126.json50.0missing{\n "num_gpu": 99\n}missing
3345Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_234455__40300.012.97210[222, 302]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234455__403.json50.0missing{\n "num_gpu": 99\n}missing
3346Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_234506__99220.010.79893[222, 247]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234506__992.json78.75missing{\n "num_gpu": 99\n}missing
3347Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_234516__27900.09.739690[222, 220]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234516__279.json0.0missing{\n "num_gpu": 99\n}missing
3348Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_234524__18300.08.317520[222, 184]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234524__183.json0.0missing{\n "num_gpu": 99\n}missing
3349Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_234843__78800.017.92920[395, 393]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234843__788.json50.0missing{\n "num_gpu": 99\n}missing
3350Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_234857__72900.013.68270[395, 289]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234857__729.json50.0missing{\n "num_gpu": 99\n}missing
3351Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_234909__68200.012.51170[395, 260]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234909__682.json25.0missing{\n "num_gpu": 99\n}missing
3352Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_234924__24500.014.98460[395, 321]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234924__245.json25.0missing{\n "num_gpu": 99\n}missing
3353Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_234937__72300.012.3810[395, 257]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234937__723.json50.0missing{\n "num_gpu": 99\n}missing
3354Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234717__21900.018.02230[393, 395]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234717__219.json50.0missing{\n "num_gpu": 99\n}missing
3355Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234729__22510.011.88054[393, 244]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234729__225.json80.0missing{\n "num_gpu": 99\n}missing
3356Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234746__69120.016.91012[393, 368]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234746__691.json72.5missing{\n "num_gpu": 99\n}missing
3357Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234803__57800.017.3910[393, 380]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234803__578.json50.0missing{\n "num_gpu": 99\n}missing
3358Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234825__50020.021.30663[393, 475]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234825__500.json78.75missing{\n "num_gpu": 99\n}missing
3359Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122042__26300.013.4470[87, 245]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122042__263.json50.0missing{\n "num_gpu": 99\n}missing
3360Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122055__58400.012.84960[87, 234]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122055__584.json50.0missing{\n "num_gpu": 99\n}missing
3361Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231227_004215__43800.010.39570[87, 187]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_004215__438.json0.0missing{\n "num_gpu": 99\n}missing
3362Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_122008__78100.06.77660[128, 115]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122008__781.json0.0missing{\n "num_gpu": 99\n}missing
3363Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_122028__92800.020.73280[128, 377]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122028__928.json0.0missing{\n "num_gpu": 99\n}missing
3364Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_004205__46200.08.83310[128, 154]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_004205__462.json0.0missing{\n "num_gpu": 99\n}missing
3365Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_121945__29800.05.794010[222, 86]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121945__298.json0.0missing{\n "num_gpu": 99\n}missing
3366Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122001__67700.015.66760[222, 271]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122001__677.json50.0missing{\n "num_gpu": 99\n}missing
3367Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_004156__68700.030.29440[222, 375]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004156__687.json50.0missing{\n "num_gpu": 99\n}missing
3368Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122255__28400.024.00080[395, 400]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122255__284.json50.0missing{\n "num_gpu": 99\n}missing
3369Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122318__58900.022.84352[395, 379]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122318__589.json62.5missing{\n "num_gpu": 99\n}missing
3370Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_004256__33600.025.39830[395, 424]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004256__336.json25.0missing{\n "num_gpu": 99\n}missing
3371Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122152__86800.031.57190[393, 536]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122152__868.json50.0missing{\n "num_gpu": 99\n}missing
3372Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122231__14810.038.89913[393, 666]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122231__148.json73.75missing{\n "num_gpu": 99\n}missing
3373Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_004231__70900.015.68130[393, 248]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_004231__709.json0.0missing{\n "num_gpu": 99\n}missing
3374Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_115432__61200.0133.0530[88, 785]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_115432__612.json50.0missing{\n "num_gpu": 99\n}missing
3375Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_115550__74100.077.97734[88, 458]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_115550__741.json75.0missing{\n "num_gpu": 99\n}missing
3376Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_115639__51500.048.55664[88, 283]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_115639__515.json75.0missing{\n "num_gpu": 99\n}missing
3377Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_151747__29700.065.21080[88, 384]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_151747__297.json50.0missing{\n "num_gpu": 99\n}missing
3378Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_151843__27620.055.88912[88, 328]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_151843__276.json72.5missing{\n "num_gpu": 99\n}missing
3379Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_115025__95000.034.56080[127, 194]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_115025__950.json0.0missing{\n "num_gpu": 99\n}missing
3380Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_115109__23400.043.43430[127, 248]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_115109__234.json0.0missing{\n "num_gpu": 99\n}missing
3381Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_115219__44100.069.81940[127, 407]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_115219__441.json0.0missing{\n "num_gpu": 99\n}missing
3382Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_151532__17000.044.44330[127, 253]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_151532__170.json0.0missing{\n "num_gpu": 99\n}missing
3383Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_151642__11200.069.93840[127, 406]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_151642__112.json50.0missing{\n "num_gpu": 99\n}missing
3384Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_114746__88720.068.37293[220, 355]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114746__887.json78.75missing{\n "num_gpu": 99\n}missing
3385Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_114844__26220.057.28171[220, 315]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114844__262.json66.25missing{\n "num_gpu": 99\n}missing
3386Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_114951__45600.066.67150[220, 371]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114951__456.json50.0missing{\n "num_gpu": 99\n}missing
3387Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_151351__73400.038.48330[220, 201]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_151351__734.json0.0missing{\n "num_gpu": 99\n}missing
3388Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_151447__31120.056.48043[220, 309]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_151447__311.json78.75missing{\n "num_gpu": 99\n}missing
3389Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_120159__73720.077.14044[401, 396]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120159__737.json85.0missing{\n "num_gpu": 99\n}missing
3390Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_120354__64300.0114.770[401, 611]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120354__643.json50.0missing{\n "num_gpu": 99\n}missing
3391Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_120624__76700.0149.2290[401, 784]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120624__767.json25.0missing{\n "num_gpu": 99\n}missing
3392Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_152141__60100.042.44284[401, 191]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_152141__601.json75.0missing{\n "num_gpu": 99\n}missing
3393Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_152325__38700.0102.9840[401, 543]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_152325__387.json25.0missing{\n "num_gpu": 99\n}missing
3394Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_115749__85600.070.38880[399, 356]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_115749__856.json50.0missing{\n "num_gpu": 99\n}missing
3395Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_115926__77000.096.40950[399, 506]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_115926__770.json50.0missing{\n "num_gpu": 99\n}missing
3396Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_120041__76000.074.7564[399, 377]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_120041__760.json75.0missing{\n "num_gpu": 99\n}missing
3397Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_151945__89400.061.19680[399, 301]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_151945__894.json50.0missing{\n "num_gpu": 99\n}missing
3398Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_152059__10800.073.87180[399, 374]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_152059__108.json50.0missing{\n "num_gpu": 99\n}missing
3399Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_150030__86300.09.310860[96, 231]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_150030__863.json50.0missing{\n "num_gpu": 99\n}missing
3400Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_150036__82820.05.833282[96, 140]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_150036__828.json72.5missing{\n "num_gpu": 99\n}missing
3401Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_004032__56200.06.928050[96, 168]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_004032__562.json50.0missing{\n "num_gpu": 99\n}missing
3402Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_150013__53820.06.009082[137, 136]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_150013__538.json72.5missing{\n "num_gpu": 99\n}missing
3403Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_150021__17000.07.361750[137, 171]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_150021__170.json0.0missing{\n "num_gpu": 99\n}missing
3404Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_004025__65100.03.341533[137, 66]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_004025__651.json68.75missing{\n "num_gpu": 99\n}missing
3405Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_145951__41120.022.72073[231, 386]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145951__411.json78.75missing{\n "num_gpu": 99\n}missing
3406Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_150007__57600.016.12040[231, 379]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150007__576.json0.0missing{\n "num_gpu": 99\n}missing
3407Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_004021__95300.022.24070[231, 382]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004021__953.json50.0missing{\n "num_gpu": 99\n}missing
3408Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_150152__86820.031.63623[404, 725]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150152__868.json78.75missing{\n "num_gpu": 99\n}missing
3409Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_150208__85300.015.70940[404, 341]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150208__853.json50.0missing{\n "num_gpu": 99\n}missing
3410Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_004049__35510.09.989443[404, 198]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004049__355.json73.75missing{\n "num_gpu": 99\n}missing
3411Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_150109__87120.013.95122[402, 298]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_150109__871.json72.5missing{\n "num_gpu": 99\n}missing
3412Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_150120__69700.011.14890[402, 228]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_150120__697.json0.0missing{\n "num_gpu": 99\n}missing
3413Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_004038__97120.06.664673[402, 115]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_004038__971.json78.75missing{\n "num_gpu": 99\n}missing
3414Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTfalsefalse520231214_005933__22500.014.77630[89, 433]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_005933__225.json0.0missingmissingmissing
3415Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_140931__36210.05.400413[94, 168]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_140931__362.json73.75missing{\n "num_gpu": 99\n}missing
3416Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_140939__87700.07.838580[94, 250]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_140939__877.json50.0missing{\n "num_gpu": 99\n}missing
3417Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231227_001824__18420.09.519024[94, 304]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_001824__184.json85.0missing{\n "num_gpu": 99\n}missing
3418Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_005918__87300.012.86750[118, 367]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_005918__873.json50.0missingmissingmissing
3419Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_140916__61500.011.40630[135, 357]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_140916__615.json50.0missing{\n "num_gpu": 99\n}missing
3420Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_140926__23220.09.270274[135, 288]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_140926__232.json85.0missing{\n "num_gpu": 99\n}missing
3421Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231227_001814__25700.011.07470[135, 345]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_001814__257.json0.0missing{\n "num_gpu": 99\n}missing
3422Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231214_005905__55400.028.47552[211, 746]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005905__554.json62.5missingmissingmissing
3423Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_140900__65500.011.1890[229, 163]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140900__655.json50.0missing{\n "num_gpu": 99\n}missing
3424Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_140905__19720.04.735524[229, 121]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140905__197.json85.0missing{\n "num_gpu": 99\n}missing
3425Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_001803__28400.017.15150[229, 363]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001803__284.json50.0missing{\n "num_gpu": 99\n}missing
3426Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231214_010031__68300.023.93210[11, 639]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_010031__683.json50.0missingmissingmissing
3427Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_141031__22100.09.828920[402, 259]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141031__221.json25.0missing{\n "num_gpu": 99\n}missing
3428Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_141044__47500.012.52010[402, 344]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141044__475.json50.0missing{\n "num_gpu": 99\n}missing
3429Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231227_001839__34200.07.866780[402, 195]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001839__342.json0.0missing{\n "num_gpu": 99\n}missing
3430Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231214_010007__87600.015.35450[389, 327]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_010007__876.json0.0missingmissingmissing
3431Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_141013__40300.016.26721[400, 460]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_141013__403.json56.25missing{\n "num_gpu": 99\n}missing
3432Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_141021__98220.07.593334[400, 187]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_141021__982.json85.0missing{\n "num_gpu": 99\n}missing
3433Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_001831__10100.07.158720[400, 172]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_001831__101.json50.0missing{\n "num_gpu": 99\n}missing
3434Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTtruefalse520231214_073019__50600.013.50430[89, 397]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231214_073019__506.json25.0missingmissingmissing
3435Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231225_143410__38900.03.404210[92, 50]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231225_143410__389.json0.0missing{\n "num_gpu": 99\n}missing
3436Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231225_143413__58800.02.512480[92, 33]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231225_143413__588.json0.0missing{\n "num_gpu": 99\n}missing
3437Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231227_002707__69300.018.55310[92, 336]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231227_002707__693.json0.0missing{\n "num_gpu": 99\n}missing
3438Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_073006__63700.06.613380[118, 182]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_073006__637.json50.0missingmissingmissing
3439Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_143356__39100.016.96530[131, 298]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_143356__391.json0.0missing{\n "num_gpu": 99\n}missing
3440Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_143407__65900.010.57390[131, 178]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_143407__659.json0.0missing{\n "num_gpu": 99\n}missing
3441Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_002649__79800.013.02090[131, 223]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_002649__798.json0.0missing{\n "num_gpu": 99\n}missing
3442Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_072959__33300.019.70940[211, 522]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_072959__333.json50.0missingmissingmissing
3443Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_143331__93800.026.72650[224, 292]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143331__938.json0.0missing{\n "num_gpu": 99\n}missing
3444Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_143339__30200.07.844110[224, 115]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143339__302.json0.0missing{\n "num_gpu": 99\n}missing
3445Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231227_002636__14700.022.73310[224, 225]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002636__147.json0.0missing{\n "num_gpu": 99\n}missing
3446Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_073128__26700.021.15970[11, 568]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073128__267.json50.0missingmissingmissing
3447Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_143640__34600.08.026870[395, 87]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143640__346.json0.0missing{\n "num_gpu": 99\n}missing
3448Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231225_143724__33400.044.38760[395, 721]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143724__334.json25.0missing{\n "num_gpu": 99\n}missing
3449Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_002740__97200.08.043790[395, 87]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002740__972.json0.0missing{\n "num_gpu": 99\n}missing
3450Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTfalsefalse520231214_073107__58600.029.95430[389, 700]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_073107__586.json0.0missingmissingmissing
3451Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTtruetrue520231225_143552__98700.063.45080[392, 1029]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_143552__987.json50.0missing{\n "num_gpu": 99\n}missing
3452Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_143632__21500.039.70040[392, 643]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_143632__215.json0.0missing{\n "num_gpu": 99\n}missing
3453Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_002732__60500.025.03420[392, 390]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_002732__605.json0.0missing{\n "num_gpu": 99\n}missing
3454Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_150239__42700.01.44930[83, 49]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_150239__427.json0.0missing{\n "num_gpu": 99\n}missing
3455Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_150308__65600.028.92370[83, 1058]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_150308__656.json0.0missing{\n "num_gpu": 99\n}missing
3456Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_004118__76000.021.31840[83, 793]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_004118__760.json0.0missing{\n "num_gpu": 99\n}missing
3457Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_150234__96700.017.36130[120, 651]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_150234__967.json0.0missing{\n "num_gpu": 99\n}missing
3458Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_150237__40900.03.141710[120, 113]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_150237__409.json0.0missing{\n "num_gpu": 99\n}missing
3459Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_004057__39600.03.349530[120, 121]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_004057__396.json0.0missing{\n "num_gpu": 99\n}missing
3460Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231225_150212__12200.04.733620[211, 16]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150212__122.json50.0missing{\n "num_gpu": 99\n}missing
3461Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231225_150217__45400.04.185410[211, 140]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150217__454.json50.0missing{\n "num_gpu": 99\n}missing
3462Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_004053__29700.04.668740[211, 15]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004053__297.json0.0missing{\n "num_gpu": 99\n}missing
3463Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_150427__59700.04.629010[372, 131]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150427__597.json0.0missing{\n "num_gpu": 99\n}missing
3464Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_150445__53400.017.34850[372, 589]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150445__534.json0.0missing{\n "num_gpu": 99\n}missing
3465Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_004126__60100.05.378210[372, 158]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004126__601.json0.0missing{\n "num_gpu": 99\n}missing
3466Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_150406__69000.07.049640[369, 222]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_150406__690.json0.0missing{\n "num_gpu": 99\n}missing
3467Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_150423__57000.016.1910[369, 549]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_150423__570.json0.0missing{\n "num_gpu": 99\n}missing
3468Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_004120__55500.02.072080[369, 33]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_004120__555.json0.0missing{\n "num_gpu": 99\n}missing
3469Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231214_073154__46300.010.81790[89, 319]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_073154__463.json50.0missingmissingmissing
3470Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231225_144014__99120.033.20643[100, 251]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_144014__991.json78.75missing{\n "num_gpu": 99\n}missing
3471Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231225_144048__25920.033.37433[100, 252]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_144048__259.json78.75missing{\n "num_gpu": 99\n}missing
3472Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231227_003000__60440.040.40343[100, 305]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_003000__604.json88.75missing{\n "num_gpu": 99\n}missing
3473Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_073143__20900.03.305410[118, 79]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_073143__209.json50.0missingmissingmissing
3474Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_143912__77020.019.24353[139, 132]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_143912__770.json78.75missing{\n "num_gpu": 99\n}missing
3475Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_143940__48120.027.74333[139, 201]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_143940__481.json78.75missing{\n "num_gpu": 99\n}missing
3476Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_002920__10350.044.76493[139, 335]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_002920__103.json93.75missing{\n "num_gpu": 99\n}missing
3477Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_073140__17800.011.39370[211, 293]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073140__178.json0.0missingmissingmissing
3478Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_143812__98750.047.85223[232, 168]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143812__987.json93.75missing{\n "num_gpu": 99\n}missing
3479Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231225_143853__61500.040.72080[232, 287]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143853__615.json0.0missing{\n "num_gpu": 99\n}missing
3480Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_002835__25750.054.5023[232, 229]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002835__257.json93.75missing{\n "num_gpu": 99\n}missing
3481Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_073233__39800.02.931570[11, 78]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073233__398.json0.0missingmissingmissing
3482Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_144412__44520.041.8933[403, 266]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_144412__445.json78.75missing{\n "num_gpu": 99\n}missing
3483Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_144439__57820.025.92373[403, 140]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_144439__578.json78.75missing{\n "num_gpu": 99\n}missing
3484Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_003148__68840.042.99063[403, 272]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003148__688.json88.75missing{\n "num_gpu": 99\n}missing
3485Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_073230__60500.021.22640[389, 483]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_073230__605.json50.0missingmissingmissing
3486Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_144248__50640.043.61093[400, 278]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_144248__506.json88.75missing{\n "num_gpu": 99\n}missing
3487Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_144330__53720.042.19532[400, 267]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_144330__537.json72.5missing{\n "num_gpu": 99\n}missing
3488Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_003105__20750.063.63833[400, 430]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_003105__207.json93.75missing{\n "num_gpu": 99\n}missing
3489Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_235031__34600.09.655950[1, 303]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_235031__346.json25.0missingmissingmissing
3490Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_235039__25800.07.681420[1, 244]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_235039__258.json25.0missingmissingmissing
3491Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_145513__47300.014.2030[96, 238]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_145513__473.json50.0missing{\n "num_gpu": 99\n}missing
3492Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_145530__52000.015.99890[96, 269]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_145530__520.json50.0missing{\n "num_gpu": 99\n}missing
3493Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_003826__82000.017.4850[96, 294]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_003826__820.json50.0missing{\n "num_gpu": 99\n}missing
3494Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_235003__77100.02.111320[1, 68]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_235003__771.json25.0missingmissingmissing
3495Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_235010__99300.07.557180[1, 237]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_235010__993.json25.0missingmissingmissing
3496Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_145439__65820.012.4313[137, 198]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145439__658.json78.75missing{\n "num_gpu": 99\n}missing
3497Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_145459__96400.019.94620[137, 328]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145459__964.json25.0missing{\n "num_gpu": 99\n}missing
3498Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_003808__45220.014.6621[137, 236]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_003808__452.json66.25missing{\n "num_gpu": 99\n}missing
3499Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_234940__38400.015.28120[1, 447]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234940__384.json0.0missingmissingmissing
3500Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_234955__10200.015.47670[1, 453]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234955__102.json25.0missingmissingmissing
3501Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_145411__59200.021.79870[231, 189]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145411__592.json0.0missing{\n "num_gpu": 99\n}missing
3502Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_145427__82200.015.91720[231, 243]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145427__822.json50.0missing{\n "num_gpu": 99\n}missing
3503Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_003754__85200.022.90930[231, 214]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_003754__852.json25.0missing{\n "num_gpu": 99\n}missing
3504Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_235249__93100.019.18120[1, 525]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_235249__931.json25.0missingmissingmissing
3505Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_235303__30800.014.06710[1, 393]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_235303__308.json0.0missingmissingmissing
3506Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_145702__54000.017.02270[404, 236]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145702__540.json0.0missing{\n "num_gpu": 99\n}missing
3507Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_145720__15800.018.02150[404, 253]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145720__158.json0.0missing{\n "num_gpu": 99\n}missing
3508Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_003904__26100.015.73650[404, 214]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003904__261.json50.0missing{\n "num_gpu": 99\n}missing
3509Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_235158__20900.014.69190[1, 410]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_235158__209.json25.0missingmissingmissing
3510Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_235211__19200.013.64350[1, 382]0.5.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_235211__192.json0.0missingmissingmissing
3511Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145631__98600.020.15740[402, 289]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145631__986.json50.0missing{\n "num_gpu": 99\n}missing
3512Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_145645__89600.014.32530[402, 191]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145645__896.json0.0missing{\n "num_gpu": 99\n}missing
3513Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_003848__49820.021.85034[402, 316]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_003848__498.json85.0missing{\n "num_gpu": 99\n}missing
3514Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTtruefalse520231214_072838__34100.012.04890[89, 356]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_072838__341.json25.0missingmissingmissing
3515Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231225_143156__21600.04.265770[96, 242]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_143156__216.json0.0missing{\n "num_gpu": 99\n}missing
3516Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231225_143203__13300.07.393670[96, 418]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_143203__133.json0.0missing{\n "num_gpu": 99\n}missing
3517Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231227_002553__69200.08.278990[96, 462]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_002553__692.json0.0missing{\n "num_gpu": 99\n}missing
3518Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_072826__70200.011.2150[118, 320]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_072826__702.json0.0missingmissingmissing
3519Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_143146__33700.07.474730[133, 411]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_143146__337.json0.0missing{\n "num_gpu": 99\n}missing
3520Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_143151__76600.05.363060[133, 292]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_143151__766.json0.0missing{\n "num_gpu": 99\n}missing
3521Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_002544__55800.06.102560[133, 332]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_002544__558.json0.0missing{\n "num_gpu": 99\n}missing
3522Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231214_072815__28400.010.91110[211, 279]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_072815__284.json0.0missingmissingmissing
3523Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231225_143131__46800.013.43350[221, 551]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143131__468.json25.0missing{\n "num_gpu": 99\n}missing
3524Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231225_143138__78100.06.936610[221, 360]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143138__781.json50.0missing{\n "num_gpu": 99\n}missing
3525Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_002538__50900.08.483540[221, 299]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002538__509.json0.0missing{\n "num_gpu": 99\n}missing
3526Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231214_072939__33300.015.82750[11, 432]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_072939__333.json50.0missingmissingmissing
3527Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_143259__10100.02.474090[383, 78]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143259__101.json0.0missing{\n "num_gpu": 99\n}missing
3528Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_143305__98400.05.95770[383, 265]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143305__984.json0.0missing{\n "num_gpu": 99\n}missing
3529Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_002613__26900.011.53030[383, 540]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002613__269.json0.0missing{\n "num_gpu": 99\n}missing
3530Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231214_072923__93600.030.33480[389, 709]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_072923__936.json0.0missingmissingmissing
3531Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_143233__16200.013.40470[381, 633]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_143233__162.json0.0missing{\n "num_gpu": 99\n}missing
3532Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_143256__50500.023.08240[381, 1064]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_143256__505.json0.0missing{\n "num_gpu": 99\n}missing
3533Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTtruefalse520231227_002602__16000.08.990960[381, 417]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_002602__160.json25.0missing{\n "num_gpu": 99\n}missing
3534Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruefalse520231214_010108__13200.011.52490[89, 340]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_010108__132.json25.0missingmissingmissing
3535Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruetrue520231225_141151__70320.016.06433[96, 519]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_141151__703.json78.75missing{\n "num_gpu": 99\n}missing
3536Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruetrue520231225_141204__29820.012.75573[96, 411]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_141204__298.json78.75missing{\n "num_gpu": 99\n}missing
3537Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruetrue520231227_001917__85720.011.07733[96, 354]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_001917__857.json78.75missing{\n "num_gpu": 99\n}missing
3538Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_010056__23700.010.95060[118, 312]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_010056__237.json50.0missingmissingmissing
3539Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_141127__71400.08.594770[137, 262]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_141127__714.json50.0missing{\n "num_gpu": 99\n}missing
3540Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_141135__46020.07.992333[137, 244]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_141135__460.json78.75missing{\n "num_gpu": 99\n}missing
3541Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_001906__24620.05.886163[137, 174]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_001906__246.json78.75missing{\n "num_gpu": 99\n}missing
3542Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_010045__95500.013.91540[211, 362]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_010045__955.json0.0missingmissingmissing
3543Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_141107__38500.023.5480[231, 554]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141107__385.json50.0missing{\n "num_gpu": 99\n}missing
3544Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_141118__41620.010.4231[231, 306]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141118__416.json66.25missing{\n "num_gpu": 99\n}missing
3545Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231227_001900__32800.020.76680[231, 470]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001900__328.json25.0missing{\n "num_gpu": 99\n}missing
3546Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231214_010157__73600.013.9550[11, 383]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_010157__736.json25.0missingmissingmissing
3547Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231225_141313__68300.09.019120[404, 232]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141313__683.json25.0missing{\n "num_gpu": 99\n}missing
3548Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_141331__95200.018.24880[404, 519]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141331__952.json50.0missing{\n "num_gpu": 99\n}missing
3549Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_001935__14020.08.552343[404, 216]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001935__140.json78.75missing{\n "num_gpu": 99\n}missing
3550Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_010143__23000.019.15730[389, 432]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_010143__230.json50.0missingmissingmissing
3551Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_141245__68320.014.61314[402, 409]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_141245__683.json85.0missing{\n "num_gpu": 99\n}missing
3552Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruefalse520231225_141304__33100.018.76930[402, 536]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_141304__331.json25.0missing{\n "num_gpu": 99\n}missing
3553Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_001927__73800.09.82463[402, 256]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_001927__738.json68.75missing{\n "num_gpu": 99\n}missing
3554Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231214_010238__24700.014.21070[89, 419]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_010238__247.json50.0missingmissingmissing
3555Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231225_141657__15300.059.11454[88, 447]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_141657__153.json75.0missing{\n "num_gpu": 99\n}missing
3556Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231225_141833__60350.096.29794[88, 724]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_141833__603.json100.0missing{\n "num_gpu": 99\n}missing
3557Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231227_002143__69500.041.90313[88, 313]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_002143__695.json68.75missing{\n "num_gpu": 99\n}missing
3558Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_010224__74900.09.715780[118, 276]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_010224__749.json50.0missingmissingmissing
3559Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_141504__47920.030.44124[127, 220]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_141504__479.json85.0missing{\n "num_gpu": 99\n}missing
3560Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_141557__14500.053.71424[127, 399]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_141557__145.json75.0missing{\n "num_gpu": 99\n}missing
3561Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_002101__13520.029.02214[127, 208]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_002101__135.json85.0missing{\n "num_gpu": 99\n}missing
3562Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_010214__36200.017.30040[211, 458]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_010214__362.json50.0missingmissingmissing
3563Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231225_141401__48000.029.23890[220, 8]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141401__480.json0.0missing{\n "num_gpu": 99\n}missing
3564Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_141433__23850.032.47723[220, 218]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141433__238.json93.75missing{\n "num_gpu": 99\n}missing
3565Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231227_002032__81600.055.99830[220, 226]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002032__816.json50.0missing{\n "num_gpu": 99\n}missing
3566Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_010612__55800.0120.5550[11, 863]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_010612__558.json0.0missingmissingmissing
3567Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_142253__53200.056.54150[401, 363]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142253__532.json50.0missing{\n "num_gpu": 99\n}missing
3568Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_142347__63900.054.50994[401, 348]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142347__639.json75.0missing{\n "num_gpu": 99\n}missing
3569Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231227_002307__79000.028.53034[401, 153]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002307__790.json75.0missing{\n "num_gpu": 99\n}missing
3570Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_010411__87320.065.07082[389, 444]0.4.041.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_010411__873.json72.5missingmissingmissing
3571Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_142102__32120.047.80974[399, 298]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_142102__321.json85.0missing{\n "num_gpu": 99\n}missing
3572Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_142156__89510.053.99883[399, 344]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_142156__895.json73.75missing{\n "num_gpu": 99\n}missing
3573Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231227_002239__58500.055.74340[399, 356]0.6.041.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_002239__585.json50.0missing{\n "num_gpu": 99\n}missing
3574Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTfalsefalse520231214_074026__80500.015.15380[113, 435]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_074026__805.json0.0missingmissingmissing
3575Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTtruefalse520231225_152232__73800.018.81360[121, 338]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_152232__738.json25.0missing{\n "num_gpu": 99\n}missing
3576Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTtruetrue520231225_152251__70950.019.57044[121, 351]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_152251__709.json100.0missing{\n "num_gpu": 99\n}missing
3577Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTtruetrue520231227_005253__89250.020.99754[121, 377]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_005253__892.json100.0missing{\n "num_gpu": 99\n}missing
3578Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231214_074010__61800.013.8840[142, 388]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_074010__618.json25.0missingmissingmissing
3579Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_152210__50500.05.042980[159, 72]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_152210__505.json0.0missing{\n "num_gpu": 99\n}missing
3580Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_152213__91900.02.859830[159, 30]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_152213__919.json0.0missing{\n "num_gpu": 99\n}missing
3581Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_005232__40240.015.40563[159, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_005232__402.json88.75missing{\n "num_gpu": 99\n}missing
3582Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231214_073957__30200.018.45130[217, 486]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073957__302.json25.0missingmissingmissing
3583Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_152150__95850.027.71094[235, 299]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152150__958.json100.0missing{\n "num_gpu": 99\n}missing
3584Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_152205__27450.015.11124[235, 246]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152205__274.json100.0missing{\n "num_gpu": 99\n}missing
3585Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_005216__62850.024.51384[235, 246]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005216__628.json100.0missing{\n "num_gpu": 99\n}missing
3586Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231214_074131__41800.027.6130[11, 720]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074131__418.json25.0missingmissingmissing
3587Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_152412__93550.023.9754[424, 369]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152412__935.json100.0missing{\n "num_gpu": 99\n}missing
3588Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231225_152423__70800.010.81930[424, 134]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152423__708.json0.0missing{\n "num_gpu": 99\n}missing
3589Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_005322__40050.013.16474[424, 176]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005322__400.json100.0missing{\n "num_gpu": 99\n}missing
3590Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231214_074104__20200.022.02550[413, 494]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_074104__202.json25.0missingmissingmissing
3591Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_152334__24100.015.78360[421, 224]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_152334__241.json50.0missing{\n "num_gpu": 99\n}missing
3592Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_152348__21930.014.08774[421, 193]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_152348__219.json90.0missing{\n "num_gpu": 99\n}missing
3593Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_005308__28440.015.50773[421, 218]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_005308__284.json88.75missing{\n "num_gpu": 99\n}missing
3594Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonInJulia1SHOTtruefalse520231214_074216__43600.017.28760[113, 495]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_074216__436.json25.0missingmissingmissing
3595Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonInJulia1SHOTfalsefalse520231225_152504__16200.011.48870[95, 206]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_152504__162.json0.0missing{\n "num_gpu": 99\n}missing
3596Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonInJulia1SHOTfalsefalse520231225_152509__89500.04.531520[95, 72]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_152509__895.json0.0missing{\n "num_gpu": 99\n}missing
3597Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231214_074159__22300.010.18010[142, 281]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_074159__223.json25.0missingmissingmissing
3598Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_152443__98000.04.037240[96, 63]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_152443__980.json25.0missing{\n "num_gpu": 99\n}missing
3599Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_152452__43500.09.605430[96, 170]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_152452__435.json0.0missing{\n "num_gpu": 99\n}missing
3600Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruefalse520231214_074148__87100.017.03360[217, 448]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074148__871.json25.0missingmissingmissing
3601Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_152436__61300.012.92160[110, 37]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152436__613.json0.0missing{\n "num_gpu": 99\n}missing
3602Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_152439__37000.02.536890[110, 29]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152439__370.json0.0missing{\n "num_gpu": 99\n}missing
3603Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231214_074338__46100.017.56130[11, 474]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074338__461.json25.0missingmissingmissing
3604Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_152541__38000.01.557490[113, 10]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152541__380.json0.0missing{\n "num_gpu": 99\n}missing
3605Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_152547__59000.06.155180[113, 99]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152547__590.json0.0missing{\n "num_gpu": 99\n}missing
3606Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231214_074321__90100.051.15920[413, 1166]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_074321__901.json25.0missingmissingmissing
3607Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_152533__49300.06.041380[110, 97]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_152533__493.json0.0missing{\n "num_gpu": 99\n}missing
3608Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_152539__66000.06.1270[110, 99]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_152539__660.json0.0missing{\n "num_gpu": 99\n}missing
3609Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_154526__41400.049.60070[111, 294]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_154526__414.json50.0missing{\n "num_gpu": 99\n}missing
3610Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_154621__87300.054.32690[111, 323]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_154621__873.json50.0missing{\n "num_gpu": 99\n}missing
3611Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_010516__56300.059.37210[111, 354]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_010516__563.json50.0missing{\n "num_gpu": 99\n}missing
3612Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_154337__89500.049.60220[152, 288]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_154337__895.json25.0missing{\n "num_gpu": 99\n}missing
3613Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_154437__15000.059.58430[152, 350]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_154437__150.json25.0missing{\n "num_gpu": 99\n}missing
3614Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_010416__13700.085.60990[152, 507]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_010416__137.json25.0missing{\n "num_gpu": 99\n}missing
3615Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_154156__82700.087.44020[226, 347]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_154156__827.json25.0missing{\n "num_gpu": 99\n}missing
3616Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_154247__14650.050.68234[226, 278]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_154247__146.json100.0missing{\n "num_gpu": 99\n}missing
3617Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_010251__21650.085.49354[226, 347]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_010251__216.json100.0missing{\n "num_gpu": 99\n}missing
3618Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_155155__60850.071.87224[440, 366]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155155__608.json100.0missing{\n "num_gpu": 99\n}missing
3619Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_155254__30600.059.37670[440, 296]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155254__306.json50.0missing{\n "num_gpu": 99\n}missing
3620Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_010749__32300.084.23590[440, 443]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_010749__323.json25.0missing{\n "num_gpu": 99\n}missing
3621Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_154931__39750.074.55784[438, 387]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_154931__397.json100.0missing{\n "num_gpu": 99\n}missing
3622Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_155042__12800.071.36810[438, 368]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155042__128.json50.0missing{\n "num_gpu": 99\n}missing
3623Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_010625__65200.068.81740[438, 352]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_010625__652.json25.0missing{\n "num_gpu": 99\n}missing
3624Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_011444__13200.07.453320[106, 282]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_011444__132.json25.0missing{\n "num_gpu": 99\n}missing
3625Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_120723__83200.012.06750[106, 456]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_120723__832.json25.0missing{\n "num_gpu": 99\n}missing
3626Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_120730__30800.07.34660[106, 278]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_120730__308.json25.0missing{\n "num_gpu": 99\n}missing
3627Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_120742__11200.011.85590[106, 446]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_120742__112.json25.0missing{\n "num_gpu": 99\n}missing
3628Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse520231227_011436__61400.06.04280[143, 222]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_011436__614.json25.0missing{\n "num_gpu": 99\n}missing
3629Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_120658__30500.07.395940[143, 274]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_120658__305.json0.0missing{\n "num_gpu": 99\n}missing
3630Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_120703__72200.05.411520[143, 196]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_120703__722.json0.0missing{\n "num_gpu": 99\n}missing
3631Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse520231227_120711__42900.07.721150[143, 286]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_120711__429.json25.0missing{\n "num_gpu": 99\n}missing
3632Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_011430__35800.012.54380[215, 330]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011430__358.json25.0missing{\n "num_gpu": 99\n}missing
3633Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_120635__93100.010.95370[215, 257]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120635__931.json0.0missing{\n "num_gpu": 99\n}missing
3634Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_120640__21300.04.920630[215, 167]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120640__213.json0.0missing{\n "num_gpu": 99\n}missing
3635Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_120650__70200.010.41920[215, 373]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120650__702.json0.0missing{\n "num_gpu": 99\n}missing
3636Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_011502__46200.06.785540[395, 205]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011502__462.json0.0missing{\n "num_gpu": 99\n}missing
3637Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_120823__83900.08.5330[395, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120823__839.json50.0missing{\n "num_gpu": 99\n}missing
3638Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_120830__54500.07.027280[395, 210]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120830__545.json0.0missing{\n "num_gpu": 99\n}missing
3639Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_120844__52000.014.78180[395, 486]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120844__520.json25.0missing{\n "num_gpu": 99\n}missing
3640Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_011456__99300.011.58290[392, 378]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_011456__993.json0.0missing{\n "num_gpu": 99\n}missing
3641Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_120749__48200.06.167030[392, 180]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_120749__482.json0.0missing{\n "num_gpu": 99\n}missing
3642Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_120801__52500.012.64170[392, 411]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_120801__525.json0.0missing{\n "num_gpu": 99\n}missing
3643Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231227_120814__53200.012.85220[392, 419]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_120814__532.json25.0missing{\n "num_gpu": 99\n}missing
3644Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTtruefalse520231214_073313__11400.011.47330[113, 330]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231214_073313__114.json25.0missingmissingmissing
3645Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTfalsefalse520231225_150549__32000.016.42830[113, 473]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231225_150549__320.json0.0missing{\n "num_gpu": 99\n}missing
3646Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTtruefalse520231225_150606__88400.016.49420[1, 498]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231225_150606__884.json25.0missing{\n "num_gpu": 99\n}missing
3647Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTfalsefalse520231227_004408__61000.014.190[113, 415]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231227_004408__610.json0.0missing{\n "num_gpu": 99\n}missing
3648Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTtruefalse520231214_073301__29100.010.36250[142, 286]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_073301__291.json25.0missingmissingmissing
3649Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTtruefalse520231225_150519__54100.013.02450[142, 365]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_150519__541.json25.0missing{\n "num_gpu": 99\n}missing
3650Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTtruefalse520231225_150533__43300.014.03560[1, 423]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_150533__433.json25.0missing{\n "num_gpu": 99\n}missing
3651Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTfalsefalse520231227_004354__84200.09.574410[142, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_004354__842.json0.0missing{\n "num_gpu": 99\n}missing
3652Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTtruefalse520231214_073251__83200.017.31020[217, 455]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073251__832.json25.0missingmissingmissing
3653Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_150457__53700.012.43880[235, 177]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150457__537.json0.0missing{\n "num_gpu": 99\n}missing
3654Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTtruefalse520231225_150506__39300.08.81890[1, 266]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150506__393.json25.0missing{\n "num_gpu": 99\n}missing
3655Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTfalsefalse520231227_004344__59700.013.30880[235, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004344__597.json0.0missing{\n "num_gpu": 99\n}missing
3656Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTfalsefalse520231214_073431__60700.026.78390[11, 699]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073431__607.json0.0missingmissingmissing
3657Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTtruefalse520231225_150743__32000.025.9220[11, 684]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150743__320.json25.0missing{\n "num_gpu": 99\n}missing
3658Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTtruefalse520231225_150803__46200.019.90870[1, 541]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150803__462.json25.0missing{\n "num_gpu": 99\n}missing
3659Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTtruefalse520231227_004500__23100.019.14550[11, 521]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004500__231.json25.0missing{\n "num_gpu": 99\n}missing
3660Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTtruefalse520231214_073404__40600.032.9710[413, 761]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_073404__406.json25.0missingmissingmissing
3661Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTtruefalse520231225_150654__70300.026.33140[413, 605]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_150654__703.json25.0missing{\n "num_gpu": 99\n}missing
3662Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTfalsefalse520231225_150717__52300.023.16210[1, 622]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_150717__523.json0.0missing{\n "num_gpu": 99\n}missing
3663Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTtruefalse520231227_004440__21900.032.54110[413, 761]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_004440__219.json25.0missing{\n "num_gpu": 99\n}missing
3664Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruefalse520231214_074416__31700.012.37130[113, 356]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231214_074416__317.json25.0missingmissingmissing
3665Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruetrue520231225_152636__42440.010.32173[113, 334]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231225_152636__424.json88.75missing{\n "num_gpu": 99\n}missing
3666Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruetrue520231225_152645__27100.08.48650[113, 271]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231225_152645__271.json50.0missing{\n "num_gpu": 99\n}missing
3667Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruetrue520231227_005359__99000.010.67980[113, 343]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231227_005359__990.json50.0missing{\n "num_gpu": 99\n}missing
3668Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruefalse520231214_074404__87500.09.817420[142, 270]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_074404__875.json25.0missingmissingmissing
3669Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruetrue520231225_152615__88050.07.885564[152, 246]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_152615__880.json100.0missing{\n "num_gpu": 99\n}missing
3670Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruetrue520231225_152626__76340.010.16043[152, 321]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_152626__763.json88.75missing{\n "num_gpu": 99\n}missing
3671Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruetrue520231227_005348__53250.07.710034[152, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_005348__532.json100.0missing{\n "num_gpu": 99\n}missing
3672Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruefalse520231214_074354__51400.015.78950[217, 414]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074354__514.json25.0missingmissingmissing
3673Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_152600__94650.013.09234[227, 204]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152600__946.json100.0missing{\n "num_gpu": 99\n}missing
3674Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_152607__71250.06.909334[227, 197]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152607__712.json100.0missing{\n "num_gpu": 99\n}missing
3675Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_005340__84250.018.94344[227, 400]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005340__842.json100.0missing{\n "num_gpu": 99\n}missing
3676Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTfalsefalse520231214_074540__51700.031.87170[11, 820]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074540__517.json0.0missingmissingmissing
3677Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTtruefalse520231225_152743__74300.010.7230[416, 292]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152743__743.json25.0missing{\n "num_gpu": 99\n}missing
3678Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTtruefalse520231225_152755__61200.012.01310[416, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152755__612.json25.0missing{\n "num_gpu": 99\n}missing
3679Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_005420__90200.010.42650[416, 280]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005420__902.json50.0missing{\n "num_gpu": 99\n}missing
3680Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTfalsefalse520231214_074508__93300.031.49760[413, 726]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_074508__933.json0.0missingmissingmissing
3681Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTtruefalse520231225_152723__50200.013.24380[413, 371]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_152723__502.json25.0missing{\n "num_gpu": 99\n}missing
3682Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTtruefalse520231225_152732__73400.09.021770[413, 238]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_152732__734.json25.0missing{\n "num_gpu": 99\n}missing
3683Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTtruetrue520231227_005410__24030.010.48784[413, 282]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_005410__240.json90.0missing{\n "num_gpu": 99\n}missing
3684Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KInJulia1SHOTfalsefalse520231227_181408__46500.015.56650[113, 297]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181408__465.json0.0missing{\n "num_gpu": 99\n}missing
3685Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_181421__82400.013.33970[113, 253]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181421__824.json25.0missing{\n "num_gpu": 99\n}missing
3686Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181439__65950.018.17064[113, 348]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181439__659.json100.0missing{\n "num_gpu": 99\n}missing
3687Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181312__13940.017.57053[152, 332]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181312__139.json88.75missing{\n "num_gpu": 99\n}missing
3688Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181330__80040.018.48873[152, 350]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181330__800.json88.75missing{\n "num_gpu": 99\n}missing
3689Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_181352__78400.022.15910[152, 421]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181352__784.json25.0missing{\n "num_gpu": 99\n}missing
3690Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181226__45100.018.55240[227, 339]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181226__451.json25.0missing{\n "num_gpu": 99\n}missing
3691Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181243__62100.017.09470[227, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181243__621.json25.0missing{\n "num_gpu": 99\n}missing
3692Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181254__10610.011.25221[227, 197]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181254__106.json61.25missing{\n "num_gpu": 99\n}missing
3693Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_181544__59900.015.30870[416, 255]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181544__599.json25.0missing{\n "num_gpu": 99\n}missing
3694Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_181608__72700.023.26540[416, 398]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181608__727.json0.0missing{\n "num_gpu": 99\n}missing
3695Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181629__52500.021.00570[416, 341]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181629__525.json50.0missing{\n "num_gpu": 99\n}missing
3696Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181457__24650.017.74224[413, 301]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181457__246.json100.0missing{\n "num_gpu": 99\n}missing
3697Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_181514__42700.016.14170[413, 270]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181514__427.json25.0missing{\n "num_gpu": 99\n}missing
3698Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181529__46950.014.74654[413, 244]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181529__469.json100.0missing{\n "num_gpu": 99\n}missing
3699Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_155741__93900.05.102940[104, 117]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_155741__939.json25.0missing{\n "num_gpu": 99\n}missing
3700Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_155746__95000.05.676220[104, 132]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_155746__950.json25.0missing{\n "num_gpu": 99\n}missing
3701Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231227_010952__72400.05.047470[104, 115]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_010952__724.json25.0missing{\n "num_gpu": 99\n}missing
3702Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_155729__36400.08.613740[145, 204]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155729__364.json25.0missing{\n "num_gpu": 99\n}missing
3703Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_155736__50300.06.331450[145, 144]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155736__503.json25.0missing{\n "num_gpu": 99\n}missing
3704Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_010947__66300.06.103350[145, 138]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_010947__663.json25.0missing{\n "num_gpu": 99\n}missing
3705Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_155716__32400.024.2520[219, 449]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155716__324.json25.0missing{\n "num_gpu": 99\n}missing
3706Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_155721__34000.04.001730[219, 74]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155721__340.json25.0missing{\n "num_gpu": 99\n}missing
3707Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_010941__27700.08.20670[219, 44]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_010941__277.json25.0missing{\n "num_gpu": 99\n}missing
3708Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_155855__22700.018.72050[412, 415]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155855__227.json25.0missing{\n "num_gpu": 99\n}missing
3709Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_155914__85100.019.38380[412, 431]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155914__851.json25.0missing{\n "num_gpu": 99\n}missing
3710Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_011027__25800.011.27510[412, 230]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011027__258.json25.0missing{\n "num_gpu": 99\n}missing
3711Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_155816__69900.014.11130[410, 302]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155816__699.json25.0missing{\n "num_gpu": 99\n}missing
3712Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_155836__36500.019.7550[410, 441]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155836__365.json25.0missing{\n "num_gpu": 99\n}missing
3713Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_011015__40300.023.63430[410, 532]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_011015__403.json25.0missing{\n "num_gpu": 99\n}missing
3714Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235109__90100.014.44490[103, 452]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235109__901.json25.0missing{\n "num_gpu": 99\n}missing
3715Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235120__76800.010.39940[103, 323]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235120__768.json25.0missing{\n "num_gpu": 99\n}missing
3716Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235130__61600.010.36110[103, 322]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235130__616.json25.0missing{\n "num_gpu": 99\n}missing
3717Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235148__53400.018.20840[103, 570]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235148__534.json25.0missing{\n "num_gpu": 99\n}missing
3718Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235158__12000.09.516570[103, 294]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235158__120.json25.0missing{\n "num_gpu": 99\n}missing
3719Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231227_235028__15500.06.226160[144, 182]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235028__155.json25.0missing{\n "num_gpu": 99\n}missing
3720Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231227_235034__73200.05.302380[144, 151]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235034__732.json25.0missing{\n "num_gpu": 99\n}missing
3721Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_235039__49400.05.44090[144, 156]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235039__494.json0.0missing{\n "num_gpu": 99\n}missing
3722Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231227_235046__69200.06.788850[144, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235046__692.json25.0missing{\n "num_gpu": 99\n}missing
3723Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231227_235055__57500.09.116970[144, 274]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235055__575.json25.0missing{\n "num_gpu": 99\n}missing
3724Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_234947__50400.010.0920[218, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234947__504.json0.0missing{\n "num_gpu": 99\n}missing
3725Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234952__39550.05.039614[218, 132]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234952__395.json100.0missing{\n "num_gpu": 99\n}missing
3726Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_235005__80900.012.62760[218, 374]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235005__809.json25.0missing{\n "num_gpu": 99\n}missing
3727Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_235012__72700.07.200250[218, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235012__727.json25.0missing{\n "num_gpu": 99\n}missing
3728Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_235022__43700.010.2570[218, 300]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235022__437.json25.0missing{\n "num_gpu": 99\n}missing
3729Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235332__29300.016.12250[411, 445]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235332__293.json25.0missing{\n "num_gpu": 99\n}missing
3730Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235343__57000.010.86570[411, 283]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235343__570.json25.0missing{\n "num_gpu": 99\n}missing
3731Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235358__23400.014.98140[411, 410]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235358__234.json25.0missing{\n "num_gpu": 99\n}missing
3732Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_235414__49800.016.0950[411, 444]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235414__498.json0.0missing{\n "num_gpu": 99\n}missing
3733Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235429__77700.014.44180[411, 393]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235429__777.json25.0missing{\n "num_gpu": 99\n}missing
3734Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_235214__21200.016.32240[409, 451]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235214__212.json50.0missing{\n "num_gpu": 99\n}missing
3735Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235231__37500.016.24420[409, 448]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235231__375.json25.0missing{\n "num_gpu": 99\n}missing
3736Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235245__93500.014.59140[409, 398]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235245__935.json25.0missing{\n "num_gpu": 99\n}missing
3737Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235302__16900.016.53610[409, 457]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235302__169.json25.0missing{\n "num_gpu": 99\n}missing
3738Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235316__42500.014.28290[409, 389]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235316__425.json25.0missing{\n "num_gpu": 99\n}missing
3739Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_235613__96450.011.96544[103, 293]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235613__964.json100.0missing{\n "num_gpu": 99\n}missing
3740Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235626__65900.012.87260[103, 316]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235626__659.json25.0missing{\n "num_gpu": 99\n}missing
3741Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235640__68400.014.20750[103, 350]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235640__684.json25.0missing{\n "num_gpu": 99\n}missing
3742Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235650__35900.010.17510[103, 247]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235650__359.json25.0missing{\n "num_gpu": 99\n}missing
3743Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235707__40100.016.38440[103, 405]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235707__401.json25.0missing{\n "num_gpu": 99\n}missing
3744Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_235530__77200.010.72640[144, 256]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235530__772.json0.0missing{\n "num_gpu": 99\n}missing
3745Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_235536__70000.05.950020[144, 133]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235536__700.json25.0missing{\n "num_gpu": 99\n}missing
3746Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_235543__47600.07.172920[144, 165]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235543__476.json25.0missing{\n "num_gpu": 99\n}missing
3747Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_235549__27530.05.944634[144, 133]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235549__275.json90.0missing{\n "num_gpu": 99\n}missing
3748Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_235601__27700.011.29210[144, 270]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235601__277.json0.0missing{\n "num_gpu": 99\n}missing
3749Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_235447__64500.018.82930[218, 428]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235447__645.json25.0missing{\n "num_gpu": 99\n}missing
3750Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_235456__36400.08.827060[218, 197]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235456__364.json25.0missing{\n "num_gpu": 99\n}missing
3751Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_235502__80650.06.060194[218, 126]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235502__806.json100.0missing{\n "num_gpu": 99\n}missing
3752Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_235510__85000.07.606730[218, 166]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235510__850.json0.0missing{\n "num_gpu": 99\n}missing
3753Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_235520__75500.09.616870[218, 217]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235520__755.json0.0missing{\n "num_gpu": 99\n}missing
3754Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_235854__79000.017.91690[411, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235854__790.json25.0missing{\n "num_gpu": 99\n}missing
3755Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_235918__94900.023.80770[411, 534]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235918__949.json25.0missing{\n "num_gpu": 99\n}missing
3756Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_235932__13400.014.03470[411, 297]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235932__134.json25.0missing{\n "num_gpu": 99\n}missing
3757Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_235947__61100.015.34990[411, 329]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235947__611.json25.0missing{\n "num_gpu": 99\n}missing
3758Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_000005__77900.018.12080[411, 397]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000005__779.json25.0missing{\n "num_gpu": 99\n}missing
3759Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235723__54800.016.23630[409, 351]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235723__548.json25.0missing{\n "num_gpu": 99\n}missing
3760Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_235741__93900.017.71430[409, 387]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235741__939.json0.0missing{\n "num_gpu": 99\n}missing
3761Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235800__61400.018.94990[409, 417]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235800__614.json25.0missing{\n "num_gpu": 99\n}missing
3762Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235819__62700.019.06570[409, 420]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235819__627.json25.0missing{\n "num_gpu": 99\n}missing
3763Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235836__43900.017.33350[409, 378]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235836__439.json25.0missing{\n "num_gpu": 99\n}missing
3764Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122418__47150.020.88994[103, 381]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122418__471.json100.0missing{\n "num_gpu": 99\n}missing
3765Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_122435__26700.016.27820[103, 295]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122435__267.json25.0missing{\n "num_gpu": 99\n}missing
3766Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_011317__61050.015.03994[103, 271]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_011317__610.json100.0missing{\n "num_gpu": 99\n}missing
3767Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231226_122346__13500.08.24430[144, 140]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122346__135.json25.0missing{\n "num_gpu": 99\n}missing
3768Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231226_122357__63800.011.10030[144, 194]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122357__638.json25.0missing{\n "num_gpu": 99\n}missing
3769Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231227_011301__67100.08.69660[144, 148]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_011301__671.json25.0missing{\n "num_gpu": 99\n}missing
3770Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122327__24400.08.595420[218, 139]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122327__244.json50.0missing{\n "num_gpu": 99\n}missing
3771Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122338__31530.010.46124[218, 174]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122338__315.json90.0missing{\n "num_gpu": 99\n}missing
3772Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_011253__56200.017.34390[218, 135]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011253__562.json0.0missing{\n "num_gpu": 99\n}missing
3773Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_122624__39500.020.50470[411, 336]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122624__395.json25.0missing{\n "num_gpu": 99\n}missing
3774Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_122649__84100.025.47830[411, 426]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122649__841.json0.0missing{\n "num_gpu": 99\n}missing
3775Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_011418__72600.033.05790[411, 560]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011418__726.json25.0missing{\n "num_gpu": 99\n}missing
3776Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_122537__25500.029.83010[409, 504]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122537__255.json25.0missing{\n "num_gpu": 99\n}missing
3777Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_122603__75500.025.6310[409, 429]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122603__755.json25.0missing{\n "num_gpu": 99\n}missing
3778Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231227_011345__64800.028.00650[409, 470]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_011345__648.json25.0missing{\n "num_gpu": 99\n}missing
3779Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_121400__76700.040.71770[107, 219]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_121400__767.json25.0missing{\n "num_gpu": 99\n}missing
3780Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_121437__42250.036.56094[107, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_121437__422.json100.0missing{\n "num_gpu": 99\n}missing
3781Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_121531__83250.053.77174[107, 277]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_121531__832.json100.0missing{\n "num_gpu": 99\n}missing
3782Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_152649__86600.036.71920[107, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_152649__866.json50.0missing{\n "num_gpu": 99\n}missing
3783Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_152725__52450.036.22574[107, 204]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_152725__524.json100.0missing{\n "num_gpu": 99\n}missing
3784Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_121202__12900.030.8450[146, 161]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_121202__129.json0.0missing{\n "num_gpu": 99\n}missing
3785Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_121232__11450.030.3074[146, 163]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_121232__114.json100.0missing{\n "num_gpu": 99\n}missing
3786Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_121319__89350.047.10664[146, 264]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_121319__893.json100.0missing{\n "num_gpu": 99\n}missing
3787Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_152537__16750.027.77264[146, 147]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_152537__167.json100.0missing{\n "num_gpu": 99\n}missing
3788Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_152612__96000.035.15850[146, 192]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_152612__960.json50.0missing{\n "num_gpu": 99\n}missing
3789Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_120950__26750.065.51924[217, 314]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120950__267.json100.0missing{\n "num_gpu": 99\n}missing
3790Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_121042__37850.051.86984[217, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_121042__378.json100.0missing{\n "num_gpu": 99\n}missing
3791Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_121131__23600.048.72470[217, 255]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_121131__236.json25.0missing{\n "num_gpu": 99\n}missing
3792Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_152423__79200.058.18120[217, 319]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_152423__792.json25.0missing{\n "num_gpu": 99\n}missing
3793Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_152509__26550.045.76654[217, 245]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_152509__265.json100.0missing{\n "num_gpu": 99\n}missing
3794Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_121844__79150.069.45794[420, 342]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_121844__791.json100.0missing{\n "num_gpu": 99\n}missing
3795Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_121915__40900.030.20090[420, 109]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_121915__409.json0.0missing{\n "num_gpu": 99\n}missing
3796Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_122057__55800.0102.3660[420, 515]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122057__558.json25.0missing{\n "num_gpu": 99\n}missing
3797Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_153059__84400.084.89170[420, 434]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153059__844.json25.0missing{\n "num_gpu": 99\n}missing
3798Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_153138__90450.039.17124[420, 167]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153138__904.json100.0missing{\n "num_gpu": 99\n}missing
3799Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_121614__47050.042.99764[418, 183]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_121614__470.json100.0missing{\n "num_gpu": 99\n}missing
3800Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_121656__18600.041.75960[418, 176]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_121656__186.json25.0missing{\n "num_gpu": 99\n}missing
3801Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_121735__36150.039.12054[418, 166]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_121735__361.json100.0missing{\n "num_gpu": 99\n}missing
3802Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_152824__24550.059.01044[418, 284]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_152824__245.json100.0missing{\n "num_gpu": 99\n}missing
3803Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_152934__69600.069.4390[418, 345]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_152934__696.json50.0missing{\n "num_gpu": 99\n}missing
3804Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_160008__58550.012.0024[112, 295]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_160008__585.json100.0missing{\n "num_gpu": 99\n}missing
3805Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_160018__65950.010.57564[112, 259]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_160018__659.json100.0missing{\n "num_gpu": 99\n}missing
3806Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231227_011110__35800.012.79410[112, 314]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_011110__358.json0.0missing{\n "num_gpu": 99\n}missing
3807Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_155946__41200.08.136610[153, 191]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155946__412.json25.0missing{\n "num_gpu": 99\n}missing
3808Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_155956__72200.09.13240[153, 216]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155956__722.json50.0missing{\n "num_gpu": 99\n}missing
3809Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_011057__35200.09.345270[153, 221]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_011057__352.json50.0missing{\n "num_gpu": 99\n}missing
3810Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_155928__48050.014.08814[227, 166]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155928__480.json100.0missing{\n "num_gpu": 99\n}missing
3811Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_155938__55350.09.824964[227, 220]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155938__553.json100.0missing{\n "num_gpu": 99\n}missing
3812Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_011048__54700.020.74390[227, 339]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011048__547.json25.0missing{\n "num_gpu": 99\n}missing
3813Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_160138__84600.017.38650[420, 378]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160138__846.json50.0missing{\n "num_gpu": 99\n}missing
3814Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_160202__20600.023.78564[420, 533]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160202__206.json75.0missing{\n "num_gpu": 99\n}missing
3815Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_011145__89700.018.69380[420, 408]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011145__897.json25.0missing{\n "num_gpu": 99\n}missing
3816Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_160104__56900.017.5390[418, 382]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_160104__569.json25.0missing{\n "num_gpu": 99\n}missing
3817Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_160121__10100.017.11880[418, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_160121__101.json25.0missing{\n "num_gpu": 99\n}missing
3818Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_011126__39950.015.85694[418, 339]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_011126__399.json100.0missing{\n "num_gpu": 99\n}missing
3819Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTtruefalse520231214_073525__82300.023.53770[113, 664]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_073525__823.json25.0missingmissingmissing
3820Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTtruefalse520231225_150846__68500.07.523480[110, 235]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_150846__685.json25.0missing{\n "num_gpu": 99\n}missing
3821Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTtruefalse520231225_150855__34800.08.863330[110, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_150855__348.json25.0missing{\n "num_gpu": 99\n}missing
3822Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTtruefalse520231227_004535__58300.010.6780[110, 337]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_004535__583.json25.0missing{\n "num_gpu": 99\n}missing
3823Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231214_073502__99900.012.66610[142, 353]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_073502__999.json25.0missingmissingmissing
3824Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231225_150831__63700.06.082510[151, 180]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_150831__637.json25.0missing{\n "num_gpu": 99\n}missing
3825Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231225_150838__80300.07.063580[151, 213]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_150838__803.json25.0missing{\n "num_gpu": 99\n}missing
3826Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231227_004524__41900.07.577850[151, 230]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_004524__419.json25.0missing{\n "num_gpu": 99\n}missing
3827Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_073449__69800.017.56310[217, 462]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073449__698.json25.0missingmissingmissing
3828Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231225_150813__25100.010.59980[225, 143]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150813__251.json25.0missing{\n "num_gpu": 99\n}missing
3829Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231225_150825__37300.011.86280[225, 354]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150825__373.json25.0missing{\n "num_gpu": 99\n}missing
3830Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231227_004517__95300.017.1570[225, 363]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004517__953.json25.0missing{\n "num_gpu": 99\n}missing
3831Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231214_073626__92500.025.08380[11, 659]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073626__925.json25.0missingmissingmissing
3832Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_150950__75400.010.27120[418, 268]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150950__754.json25.0missing{\n "num_gpu": 99\n}missing
3833Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_151006__31200.016.20160[418, 452]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_151006__312.json25.0missing{\n "num_gpu": 99\n}missing
3834Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_004602__94650.010.96324[418, 288]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004602__946.json100.0missing{\n "num_gpu": 99\n}missing
3835Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231214_073600__89600.020.2740[413, 449]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_073600__896.json25.0missingmissingmissing
3836Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_150925__45900.08.836160[416, 227]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_150925__459.json25.0missing{\n "num_gpu": 99\n}missing
3837Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_150939__80200.014.12210[416, 393]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_150939__802.json25.0missing{\n "num_gpu": 99\n}missing
3838Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231227_004551__21800.016.08760[416, 451]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_004551__218.json25.0missing{\n "num_gpu": 99\n}missing
3839Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTtruefalse520231214_074803__73300.012.84170[113, 370]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231214_074803__733.json25.0missingmissingmissing
3840Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTtruetrue520231225_153029__31000.011.94240[116, 209]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231225_153029__310.json50.0missing{\n "num_gpu": 99\n}missing
3841Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTfalsefalse520231225_153038__80400.09.03080[116, 153]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231225_153038__804.json0.0missing{\n "num_gpu": 99\n}missing
3842Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTtruetrue520231227_005603__26300.013.82330[116, 243]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231227_005603__263.json50.0missing{\n "num_gpu": 99\n}missing
3843Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTtruefalse520231214_074750__21500.09.328740[142, 255]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_074750__215.json25.0missingmissingmissing
3844Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_153005__15000.04.164750[155, 55]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_153005__150.json0.0missing{\n "num_gpu": 99\n}missing
3845Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_153017__62500.011.66330[155, 197]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_153017__625.json0.0missing{\n "num_gpu": 99\n}missing
3846Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_005550__19600.06.208770[155, 94]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_005550__196.json0.0missing{\n "num_gpu": 99\n}missing
3847Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231214_074740__88600.016.23540[217, 426]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074740__886.json25.0missingmissingmissing
3848Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_152942__53200.027.99050[230, 310]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152942__532.json50.0missing{\n "num_gpu": 99\n}missing
3849Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_153001__21200.019.6010[230, 328]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_153001__212.json0.0missing{\n "num_gpu": 99\n}missing
3850Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231227_005543__63900.037.89650[230, 493]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005543__639.json25.0missing{\n "num_gpu": 99\n}missing
3851Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231214_074913__51600.024.36480[11, 643]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074913__516.json0.0missingmissingmissing
3852Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_153221__27000.026.39580[419, 410]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_153221__270.json0.0missing{\n "num_gpu": 99\n}missing
3853Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231225_153247__21400.026.2390[419, 407]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_153247__214.json25.0missing{\n "num_gpu": 99\n}missing
3854Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_005650__38400.020.47330[419, 305]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005650__384.json0.0missing{\n "num_gpu": 99\n}missing
3855Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTtruefalse520231214_074849__56700.034.0820[413, 787]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_074849__567.json25.0missingmissingmissing
3856Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTtruefalse520231225_153120__95300.024.02390[416, 373]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_153120__953.json25.0missing{\n "num_gpu": 99\n}missing
3857Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_153154__18300.033.91530[416, 543]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_153154__183.json0.0missing{\n "num_gpu": 99\n}missing
3858Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_005629__78500.025.81940[416, 402]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_005629__785.json0.0missing{\n "num_gpu": 99\n}missing
3859Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_160249__54300.022.5050[100, 835]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_160249__543.json0.0missing{\n "num_gpu": 99\n}missing
3860Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_160310__23400.020.89450[100, 779]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_160310__234.json0.0missing{\n "num_gpu": 99\n}missing
3861Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231227_011218__74000.014.86520[100, 560]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_011218__740.json25.0missing{\n "num_gpu": 99\n}missing
3862Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_160214__20500.06.423650[137, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_160214__205.json0.0missing{\n "num_gpu": 99\n}missing
3863Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_160226__69400.011.87930[137, 446]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_160226__694.json0.0missing{\n "num_gpu": 99\n}missing
3864Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_011203__56000.014.33230[137, 533]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_011203__560.json0.0missing{\n "num_gpu": 99\n}missing
3865Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_160207__58300.04.38990[209, 2]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160207__583.json0.0missing{\n "num_gpu": 99\n}missing
3866Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_160208__44200.00.9157090[209, 11]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160208__442.json0.0missing{\n "num_gpu": 99\n}missing
3867Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_011149__28800.04.343520[209, 10]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011149__288.json0.0missing{\n "num_gpu": 99\n}missing
3868Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231225_160413__22900.08.930360[389, 286]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160413__229.json25.0missing{\n "num_gpu": 99\n}missing
3869Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_160424__83000.010.83220[389, 354]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160424__830.json0.0missing{\n "num_gpu": 99\n}missing
3870Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_011235__98200.08.256120[389, 259]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011235__982.json25.0missing{\n "num_gpu": 99\n}missing
3871Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_160351__45300.012.40[386, 410]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_160351__453.json0.0missing{\n "num_gpu": 99\n}missing
3872Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse520231225_160404__61800.012.85880[386, 427]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_160404__618.json25.0missing{\n "num_gpu": 99\n}missing
3873Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_011227__52100.09.08660[386, 290]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_011227__521.json0.0missing{\n "num_gpu": 99\n}missing
3874Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruefalse520231214_075006__88300.015.53070[113, 446]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_075006__883.json25.0missingmissingmissing
3875Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruefalse520231225_153545__85500.034.29470[124, 259]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_153545__855.json25.0missing{\n "num_gpu": 99\n}missing
3876Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_153623__84100.038.30170[124, 291]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_153623__841.json50.0missing{\n "num_gpu": 99\n}missing
3877Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruefalse520231227_005918__11900.056.70[124, 432]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_005918__119.json25.0missing{\n "num_gpu": 99\n}missing
3878Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruefalse520231214_074950__38600.017.91480[142, 500]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_074950__386.json25.0missingmissingmissing
3879Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_153432__72600.028.29640[163, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_153432__726.json50.0missing{\n "num_gpu": 99\n}missing
3880Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruefalse520231225_153511__76000.038.16920[163, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_153511__760.json25.0missing{\n "num_gpu": 99\n}missing
3881Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_005821__52700.027.48330[163, 193]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_005821__527.json50.0missing{\n "num_gpu": 99\n}missing
3882Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231214_074932__83300.018.71330[217, 494]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074932__833.json25.0missingmissingmissing
3883Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_153334__12950.046.84634[238, 160]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_153334__129.json100.0missing{\n "num_gpu": 99\n}missing
3884Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_153404__37250.030.07184[238, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_153404__372.json100.0missing{\n "num_gpu": 99\n}missing
3885Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231227_005754__98000.064.15160[238, 307]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005754__980.json25.0missing{\n "num_gpu": 99\n}missing
3886Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231214_075120__17400.025.89880[11, 679]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075120__174.json50.0missingmissingmissing
3887Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_153947__10800.049.58440[427, 318]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_153947__108.json50.0missing{\n "num_gpu": 99\n}missing
3888Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_154029__48500.041.37160[427, 254]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_154029__485.json50.0missing{\n "num_gpu": 99\n}missing
3889Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_010125__99000.062.41560[427, 412]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_010125__990.json50.0missing{\n "num_gpu": 99\n}missing
3890Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231214_075054__80100.033.38060[413, 771]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_075054__801.json25.0missingmissingmissing
3891Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_153816__69900.030.62520[424, 172]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_153816__699.json50.0missing{\n "num_gpu": 99\n}missing
3892Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_153857__75900.040.61020[424, 250]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_153857__759.json50.0missing{\n "num_gpu": 99\n}missing
3893Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_010022__45100.063.97430[424, 427]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_010022__451.json50.0missing{\n "num_gpu": 99\n}missing
3894Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231225_155417__82200.024.8340[112, 417]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_155417__822.json25.0missing{\n "num_gpu": 99\n}missing
3895Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231225_155438__61200.020.78020[112, 347]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_155438__612.json25.0missing{\n "num_gpu": 99\n}missing
3896Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231227_010850__76800.021.84880[112, 364]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_010850__768.json25.0missing{\n "num_gpu": 99\n}missing
3897Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_155341__56000.014.83030[153, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155341__560.json0.0missing{\n "num_gpu": 99\n}missing
3898Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_155353__32000.011.33180[153, 178]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155353__320.json0.0missing{\n "num_gpu": 99\n}missing
3899Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_010829__77700.012.57690[153, 199]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_010829__777.json0.0missing{\n "num_gpu": 99\n}missing
3900Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_155315__24800.020.04530[227, 156]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155315__248.json0.0missing{\n "num_gpu": 99\n}missing
3901Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_155326__87100.011.49740[227, 167]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155326__871.json0.0missing{\n "num_gpu": 99\n}missing
3902Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_010816__29600.026.65560[227, 278]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_010816__296.json0.0missing{\n "num_gpu": 99\n}missing
3903Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_155621__43700.020.06420[420, 283]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155621__437.json0.0missing{\n "num_gpu": 99\n}missing
3904Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_155652__24400.030.73660[420, 459]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155652__244.json25.0missing{\n "num_gpu": 99\n}missing
3905Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_010932__80800.022.9180[420, 329]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_010932__808.json0.0missing{\n "num_gpu": 99\n}missing
3906Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_155536__41200.018.75330[418, 261]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155536__412.json0.0missing{\n "num_gpu": 99\n}missing
3907Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_155601__64100.025.57850[418, 375]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155601__641.json25.0missing{\n "num_gpu": 99\n}missing
3908Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_010909__17200.018.92630[418, 263]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_010909__172.json0.0missing{\n "num_gpu": 99\n}missing
3909Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231214_074620__86600.014.88850[113, 428]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_074620__866.json0.0missingmissingmissing
3910Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231225_152831__17900.05.606490[113, 314]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_152831__179.json0.0missing{\n "num_gpu": 99\n}missing
3911Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTtruefalse520231225_152838__31800.06.955340[113, 388]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_152838__318.json25.0missing{\n "num_gpu": 99\n}missing
3912Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231227_005447__94400.08.172570[113, 450]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_005447__944.json0.0missing{\n "num_gpu": 99\n}missing
3913Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231214_074605__35000.09.501680[142, 261]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_074605__350.json25.0missingmissingmissing
3914Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_152818__37800.05.964260[150, 325]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_152818__378.json0.0missing{\n "num_gpu": 99\n}missing
3915Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231225_152826__42800.08.299830[150, 452]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_152826__428.json25.0missing{\n "num_gpu": 99\n}missing
3916Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231227_005439__11700.09.604220[150, 515]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_005439__117.json25.0missing{\n "num_gpu": 99\n}missing
3917Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231214_074555__77800.015.34580[217, 402]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074555__778.json25.0missingmissingmissing
3918Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_152805__34000.010.35070[220, 391]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152805__340.json0.0missing{\n "num_gpu": 99\n}missing
3919Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_152812__99700.06.215820[220, 322]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152812__997.json0.0missing{\n "num_gpu": 99\n}missing
3920Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_005429__99500.09.057950[220, 331]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005429__995.json0.0missing{\n "num_gpu": 99\n}missing
3921Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231214_074724__91100.027.61630[11, 721]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074724__911.json25.0missingmissingmissing
3922Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_152908__98100.06.266130[400, 275]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152908__981.json25.0missing{\n "num_gpu": 99\n}missing
3923Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_152914__72400.05.590330[400, 240]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152914__724.json0.0missing{\n "num_gpu": 99\n}missing
3924Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231227_005505__13200.07.629890[400, 342]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005505__132.json25.0missing{\n "num_gpu": 99\n}missing
3925Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231214_074656__16100.022.64540[413, 510]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_074656__161.json25.0missingmissingmissing
3926Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_152855__49900.08.696090[398, 399]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_152855__499.json25.0missing{\n "num_gpu": 99\n}missing
3927Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_152902__63500.06.424820[398, 284]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_152902__635.json25.0missing{\n "num_gpu": 99\n}missing
3928Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_005458__73700.010.71130[398, 494]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_005458__737.json0.0missing{\n "num_gpu": 99\n}missing
3929Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTtruefalse520231214_073653__83600.012.59010[113, 363]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_073653__836.json25.0missingmissingmissing
3930Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTtruefalse520231225_151057__33200.08.896590[112, 280]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_151057__332.json25.0missing{\n "num_gpu": 99\n}missing
3931Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTtruetrue520231225_151110__30800.013.42020[112, 427]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_151110__308.json50.0missing{\n "num_gpu": 99\n}missing
3932Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTtruefalse520231227_004632__40600.07.85590[112, 244]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_004632__406.json25.0missing{\n "num_gpu": 99\n}missing
3933Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231214_073640__69000.06.97440[142, 185]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_073640__690.json25.0missingmissingmissing
3934Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231225_151037__82400.09.70040[153, 300]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_151037__824.json25.0missing{\n "num_gpu": 99\n}missing
3935Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231225_151048__16600.011.32510[153, 353]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_151048__166.json25.0missing{\n "num_gpu": 99\n}missing
3936Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_004624__45300.010.73860[153, 332]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_004624__453.json50.0missing{\n "num_gpu": 99\n}missing
3937Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_073633__70400.07.439550[217, 176]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073633__704.json0.0missingmissingmissing
3938Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231225_151022__21500.015.57280[227, 302]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151022__215.json25.0missing{\n "num_gpu": 99\n}missing
3939Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_151027__30700.05.239070[227, 137]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151027__307.json50.0missing{\n "num_gpu": 99\n}missing
3940Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231227_004614__73900.011.36670[227, 169]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004614__739.json25.0missing{\n "num_gpu": 99\n}missing
3941Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231214_073756__15700.020.32550[11, 543]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073756__157.json25.0missingmissingmissing
3942Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231225_151207__28900.011.64280[420, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_151207__289.json25.0missing{\n "num_gpu": 99\n}missing
3943Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231225_151220__37900.012.92660[420, 350]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_151220__379.json25.0missing{\n "num_gpu": 99\n}missing
3944Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_004652__89200.010.63620[420, 277]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004652__892.json50.0missing{\n "num_gpu": 99\n}missing
3945Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231214_073736__33300.026.48570[413, 605]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_073736__333.json25.0missingmissingmissing
3946Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231225_151145__98800.014.42380[418, 397]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_151145__988.json25.0missing{\n "num_gpu": 99\n}missing
3947Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231225_151155__83900.010.18270[418, 265]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_151155__839.json25.0missing{\n "num_gpu": 99\n}missing
3948Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231227_004642__15600.09.520750[418, 242]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_004642__156.json25.0missing{\n "num_gpu": 99\n}missing
3949Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruefalse520231214_073838__12000.014.42590[113, 415]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_073838__120.json25.0missingmissingmissing
3950Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruetrue520231225_151446__49850.039.82284[107, 293]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_151446__498.json100.0missing{\n "num_gpu": 99\n}missing
3951Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruefalse520231225_151535__82600.048.80080[107, 362]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_151535__826.json25.0missing{\n "num_gpu": 99\n}missing
3952Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruefalse520231227_004855__98100.071.99640[107, 537]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_004855__981.json25.0missing{\n "num_gpu": 99\n}missing
3953Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231214_073824__55400.011.67210[142, 324]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_073824__554.json25.0missingmissingmissing
3954Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_151341__26000.022.96430[146, 156]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_151341__260.json25.0missing{\n "num_gpu": 99\n}missing
3955Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_151406__94800.025.13580[146, 173]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_151406__948.json25.0missing{\n "num_gpu": 99\n}missing
3956Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231227_004743__59800.021.82470[146, 147]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_004743__598.json25.0missing{\n "num_gpu": 99\n}missing
3957Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231214_073812__22600.015.77430[217, 413]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073812__226.json0.0missingmissingmissing
3958Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_151300__42200.040.00070[217, 76]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151300__422.json25.0missing{\n "num_gpu": 99\n}missing
3959Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_151318__66400.018.39430[217, 109]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151318__664.json25.0missing{\n "num_gpu": 99\n}missing
3960Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231227_004721__76100.028.3810[217, 11]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004721__761.json0.0missing{\n "num_gpu": 99\n}missing
3961Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_073938__36000.025.10370[11, 661]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073938__360.json0.0missingmissingmissing
3962Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_152004__90950.043.67454[420, 262]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152004__909.json100.0missing{\n "num_gpu": 99\n}missing
3963Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_152122__17100.077.80060[420, 512]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152122__171.json25.0missing{\n "num_gpu": 99\n}missing
3964Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231227_005151__79600.089.90020[420, 597]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005151__796.json25.0missing{\n "num_gpu": 99\n}missing
3965Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTtruefalse520231214_073913__99200.024.55220[413, 557]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_073913__992.json25.0missingmissingmissing
3966Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_151835__51500.061.27110[418, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_151835__515.json25.0missing{\n "num_gpu": 99\n}missing
3967Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_151920__87350.045.39654[418, 275]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_151920__873.json100.0missing{\n "num_gpu": 99\n}missing
3968Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTfalsefalse520231227_005021__31300.086.39580[418, 573]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_005021__313.json0.0missing{\n "num_gpu": 99\n}missing
3969Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruefalse520231214_075653__86000.010.71230[69, 320]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_075653__860.json25.0missingmissingmissing
3970Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruetrue520231225_115301__25230.010.00624[77, 178]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_115301__252.json90.0missing{\n "num_gpu": 99\n}missing
3971Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruetrue520231225_115312__71810.010.62324[77, 190]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_115312__718.json80.0missing{\n "num_gpu": 99\n}missing
3972Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruetrue520231227_012209__40730.010.99134[77, 196]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_012209__407.json90.0missing{\n "num_gpu": 99\n}missing
3973Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231214_075642__35500.08.594610[98, 246]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_075642__355.json25.0missingmissingmissing
3974Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_115243__60750.012.37164[115, 218]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_115243__607.json100.0missing{\n "num_gpu": 99\n}missing
3975Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_115251__42130.07.509324[115, 125]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_115251__421.json90.0missing{\n "num_gpu": 99\n}missing
3976Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_012158__73350.06.438464[115, 104]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_012158__733.json100.0missing{\n "num_gpu": 99\n}missing
3977Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231214_075634__36900.011.530[188, 305]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075634__369.json0.0missingmissingmissing
3978Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_115224__70100.014.64420[206, 59]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115224__701.json0.0missing{\n "num_gpu": 99\n}missing
3979Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_115231__24620.06.397344[206, 88]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115231__246.json85.0missing{\n "num_gpu": 99\n}missing
3980Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231227_012151__72100.012.61920[206, 28]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012151__721.json0.0missing{\n "num_gpu": 99\n}missing
3981Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231214_075730__30400.017.77950[11, 485]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075730__304.json25.0missingmissingmissing
3982Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231225_115407__61600.017.48610[380, 265]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115407__616.json0.0missing{\n "num_gpu": 99\n}missing
3983Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_115426__31730.018.89384[380, 290]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115426__317.json90.0missing{\n "num_gpu": 99\n}missing
3984Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_012234__34930.016.76664[380, 250]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012234__349.json90.0missing{\n "num_gpu": 99\n}missing
3985Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_075712__18500.012.87980[369, 273]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_075712__185.json0.0missingmissingmissing
3986Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_115335__18400.016.69280[377, 250]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_115335__184.json50.0missing{\n "num_gpu": 99\n}missing
3987Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_115350__14750.014.20064[377, 206]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_115350__147.json100.0missing{\n "num_gpu": 99\n}missing
3988Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_012217__82950.08.204084[377, 95]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_012217__829.json100.0missing{\n "num_gpu": 99\n}missing
3989Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonInJulia1SHOTtruefalse520231214_075806__36000.09.694650[69, 289]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_075806__360.json25.0missingmissingmissing
3990Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonInJulia1SHOTfalsefalse520231225_115456__60800.04.017780[51, 68]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_115456__608.json0.0missing{\n "num_gpu": 99\n}missing
3991Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonInJulia1SHOTfalsefalse520231225_115500__43600.04.487620[51, 77]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_115500__436.json0.0missing{\n "num_gpu": 99\n}missing
3992Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231214_075756__80410.06.536980[98, 184]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_075756__804.json55.0missingmissingmissing
3993Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_115445__55800.02.387130[52, 36]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_115445__558.json0.0missing{\n "num_gpu": 99\n}missing
3994Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_115452__74300.06.920080[52, 124]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_115452__743.json0.0missing{\n "num_gpu": 99\n}missing
3995Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231214_075750__40100.019.50670[188, 527]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075750__401.json0.0missingmissingmissing
3996Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_115439__14900.012.75310[81, 37]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115439__149.json0.0missing{\n "num_gpu": 99\n}missing
3997Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_115442__75700.03.122040[81, 45]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115442__757.json0.0missing{\n "num_gpu": 99\n}missing
3998Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_075851__10200.019.30530[11, 525]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075851__102.json50.0missingmissingmissing
3999Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_115526__37600.01.362460[69, 11]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115526__376.json0.0missing{\n "num_gpu": 99\n}missing
4000Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_115532__92600.06.561860[69, 112]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115532__926.json0.0missing{\n "num_gpu": 99\n}missing
4001Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_075832__70800.016.67630[369, 375]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_075832__708.json0.0missingmissingmissing
4002Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_115517__96800.05.36880[66, 89]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_115517__968.json0.0missing{\n "num_gpu": 99\n}missing
4003Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_115525__39500.07.391240[66, 128]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_115525__395.json0.0missing{\n "num_gpu": 99\n}missing
4004Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121031__75950.022.41664[70, 129]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121031__759.json100.0missing{\n "num_gpu": 99\n}missing
4005Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121117__51110.045.10290[70, 272]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121117__511.json55.0missing{\n "num_gpu": 99\n}missing
4006Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_013007__62650.032.91274[70, 195]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_013007__626.json100.0missing{\n "num_gpu": 99\n}missing
4007Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_120946__32100.032.21840[111, 185]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_120946__321.json0.0missing{\n "num_gpu": 99\n}missing
4008Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_121009__47000.022.66710[111, 125]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121009__470.json0.0missing{\n "num_gpu": 99\n}missing
4009Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_012934__90200.08.157280[111, 33]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_012934__902.json0.0missing{\n "num_gpu": 99\n}missing
4010Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_120844__61100.052.6340[201, 136]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120844__611.json0.0missing{\n "num_gpu": 99\n}missing
4011Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_120914__21000.030.09260[201, 156]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120914__210.json0.0missing{\n "num_gpu": 99\n}missing
4012Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_012926__41800.052.63610[201, 151]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012926__418.json0.0missing{\n "num_gpu": 99\n}missing
4013Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121406__31040.035.74234[399, 159]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121406__310.json95.0missing{\n "num_gpu": 99\n}missing
4014Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121446__56800.040.29360[399, 187]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121446__568.json50.0missing{\n "num_gpu": 99\n}missing
4015Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013125__33730.046.66544[399, 225]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013125__337.json90.0missing{\n "num_gpu": 99\n}missing
4016Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121257__53050.049.49354[397, 243]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121257__530.json100.0missing{\n "num_gpu": 99\n}missing
4017Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121330__11530.032.30434[397, 138]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121330__115.json90.0missing{\n "num_gpu": 99\n}missing
4018Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013038__83630.030.21534[397, 125]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013038__836.json90.0missing{\n "num_gpu": 99\n}missing
4019Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_013649__44300.05.202290[71, 199]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_013649__443.json50.0missing{\n "num_gpu": 99\n}missing
4020Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_122137__59200.08.170880[71, 315]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_122137__592.json50.0missing{\n "num_gpu": 99\n}missing
4021Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_122143__93600.05.288450[71, 203]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_122143__936.json50.0missing{\n "num_gpu": 99\n}missing
4022Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_122150__59100.07.488930[71, 287]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_122150__591.json50.0missing{\n "num_gpu": 99\n}missing
4023Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_013644__22400.06.338720[108, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_013644__224.json50.0missing{\n "num_gpu": 99\n}missing
4024Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_122118__68600.05.141390[108, 191]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_122118__686.json50.0missing{\n "num_gpu": 99\n}missing
4025Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_122124__17430.05.518184[108, 203]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_122124__174.json90.0missing{\n "num_gpu": 99\n}missing
4026Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_122129__55200.05.120590[108, 191]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_122129__552.json50.0missing{\n "num_gpu": 99\n}missing
4027Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_013637__20600.05.121790[196, 44]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013637__206.json50.0missing{\n "num_gpu": 99\n}missing
4028Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_122106__66900.08.330830[196, 165]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122106__669.json0.0missing{\n "num_gpu": 99\n}missing
4029Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_122107__71500.01.783430[196, 46]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122107__715.json50.0missing{\n "num_gpu": 99\n}missing
4030Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_122113__90900.04.976840[196, 171]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122113__909.json25.0missing{\n "num_gpu": 99\n}missing
4031Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_013658__45400.04.951560[360, 143]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013658__454.json50.0missing{\n "num_gpu": 99\n}missing
4032Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_122231__10300.010.62994[360, 351]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122231__103.json75.0missing{\n "num_gpu": 99\n}missing
4033Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_122241__64800.09.95920[360, 326]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122241__648.json25.0missing{\n "num_gpu": 99\n}missing
4034Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_122248__78800.07.340040[360, 230]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122248__788.json0.0missing{\n "num_gpu": 99\n}missing
4035Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_013653__69900.04.006860[357, 108]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_013653__699.json50.0missing{\n "num_gpu": 99\n}missing
4036Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_122203__14410.013.010[357, 434]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_122203__144.json55.0missing{\n "num_gpu": 99\n}missing
4037Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_122214__34800.010.0710[357, 331]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_122214__348.json0.0missing{\n "num_gpu": 99\n}missing
4038Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_122220__42700.06.539030[357, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_122220__427.json50.0missing{\n "num_gpu": 99\n}missing
4039Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruefalse520231214_075147__23200.09.140140[69, 271]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231214_075147__232.json25.0missingmissingmissing
4040Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruefalse520231225_113939__28700.011.02090[69, 331]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231225_113939__287.json25.0missing{\n "num_gpu": 99\n}missing
4041Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruetrue520231225_113950__87930.010.80644[1, 341]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231225_113950__879.json90.0missing{\n "num_gpu": 99\n}missing
4042Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruetrue520231227_011538__12500.07.973434[69, 241]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231227_011538__125.json75.0missing{\n "num_gpu": 99\n}missing
4043Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruetrue520231214_075138__95310.06.774550[98, 190]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_075138__953.json55.0missingmissingmissing
4044Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruefalse520231225_113920__71600.08.377180[98, 241]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_113920__716.json25.0missing{\n "num_gpu": 99\n}missing
4045Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruefalse520231225_113928__56100.07.453680[1, 235]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_113928__561.json25.0missing{\n "num_gpu": 99\n}missing
4046Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruetrue520231227_011530__23320.07.762254[98, 225]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_011530__233.json85.0missing{\n "num_gpu": 99\n}missing
4047Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231214_075131__32710.011.00890[188, 288]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075131__327.json55.0missingmissingmissing
4048Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231225_113904__17210.020.27610[206, 398]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113904__172.json55.0missing{\n "num_gpu": 99\n}missing
4049Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231225_113912__72610.07.326420[1, 224]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113912__726.json55.0missing{\n "num_gpu": 99\n}missing
4050Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231227_011522__32010.019.40210[206, 401]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011522__320.json55.0missing{\n "num_gpu": 99\n}missing
4051Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruetrue520231214_075249__86700.030.80580[11, 806]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075249__867.json50.0missingmissingmissing
4052Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruetrue520231225_114107__64800.016.41830[11, 452]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114107__648.json50.0missing{\n "num_gpu": 99\n}missing
4053Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruefalse520231225_114140__67100.032.85060[1, 862]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114140__671.json25.0missing{\n "num_gpu": 99\n}missing
4054Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruetrue520231227_011617__16300.018.31490[11, 506]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011617__163.json50.0missing{\n "num_gpu": 99\n}missing
4055Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTtruefalse520231214_075219__33700.021.9220[369, 512]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_075219__337.json25.0missingmissingmissing
4056Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTfalsefalse520231225_114029__28100.019.28510[369, 447]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_114029__281.json0.0missing{\n "num_gpu": 99\n}missing
4057Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTtruetrue520231225_114050__40720.020.82014[1, 571]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_114050__407.json85.0missing{\n "num_gpu": 99\n}missing
4058Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTtruetrue520231227_011558__69710.020.1394[369, 473]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_011558__697.json80.0missing{\n "num_gpu": 99\n}missing
4059Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruefalse520231214_075925__72700.010.79110[69, 322]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231214_075925__727.json25.0missingmissingmissing
4060Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231225_115611__12950.03.870664[69, 120]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231225_115611__129.json100.0missing{\n "num_gpu": 99\n}missing
4061Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231225_115617__69950.05.76484[69, 186]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231225_115617__699.json100.0missing{\n "num_gpu": 99\n}missing
4062Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231227_012301__54550.07.673754[69, 249]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231227_012301__545.json100.0missing{\n "num_gpu": 99\n}missing
4063Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231214_075914__60910.08.579430[98, 246]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_075914__609.json55.0missingmissingmissing
4064Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231225_115559__49310.07.707620[108, 247]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_115559__493.json55.0missing{\n "num_gpu": 99\n}missing
4065Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231225_115607__81450.07.120724[108, 225]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_115607__814.json100.0missing{\n "num_gpu": 99\n}missing
4066Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231227_012253__53550.06.415644[108, 201]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_012253__535.json100.0missing{\n "num_gpu": 99\n}missing
4067Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_075906__37300.014.16370[188, 380]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075906__373.json0.0missingmissingmissing
4068Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_115545__75510.012.97544[198, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115545__755.json80.0missing{\n "num_gpu": 99\n}missing
4069Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_115552__21450.06.039384[198, 174]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115552__214.json100.0missing{\n "num_gpu": 99\n}missing
4070Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_012247__40850.012.50724[198, 196]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012247__408.json100.0missing{\n "num_gpu": 99\n}missing
4071Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_080019__90910.017.88864[11, 488]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080019__909.json80.0missingmissingmissing
4072Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_115644__64550.06.421664[372, 159]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115644__645.json100.0missing{\n "num_gpu": 99\n}missing
4073Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_115657__68310.013.05120[372, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115657__683.json55.0missing{\n "num_gpu": 99\n}missing
4074Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_012318__32200.08.257770[372, 218]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012318__322.json50.0missing{\n "num_gpu": 99\n}missing
4075Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231214_080001__64400.027.67340[369, 656]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_080001__644.json50.0missingmissingmissing
4076Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231225_115632__59950.06.902014[369, 175]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_115632__599.json100.0missing{\n "num_gpu": 99\n}missing
4077Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231225_115638__21430.05.042924[369, 114]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_115638__214.json90.0missing{\n "num_gpu": 99\n}missing
4078Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231227_012310__65050.08.132644[369, 214]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_012310__650.json100.0missing{\n "num_gpu": 99\n}missing
4079Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181743__63950.011.3314[69, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181743__639.json100.0missing{\n "num_gpu": 99\n}missing
4080Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181755__85950.011.61284[69, 208]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181755__859.json100.0missing{\n "num_gpu": 99\n}missing
4081Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181805__87850.010.01434[69, 180]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181805__878.json100.0missing{\n "num_gpu": 99\n}missing
4082Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181716__58110.012.45164[108, 222]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181716__581.json80.0missing{\n "num_gpu": 99\n}missing
4083Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181725__97050.08.438324[108, 145]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181725__970.json100.0missing{\n "num_gpu": 99\n}missing
4084Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181732__78910.06.94840[108, 119]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181732__789.json55.0missing{\n "num_gpu": 99\n}missing
4085Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181641__91350.011.75274[198, 192]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181641__913.json100.0missing{\n "num_gpu": 99\n}missing
4086Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181651__52650.010.1844[198, 170]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181651__526.json100.0missing{\n "num_gpu": 99\n}missing
4087Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181703__90250.012.12884[198, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181703__902.json100.0missing{\n "num_gpu": 99\n}missing
4088Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181856__90050.014.53294[372, 238]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181856__900.json100.0missing{\n "num_gpu": 99\n}missing
4089Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181905__26610.08.941610[372, 133]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181905__266.json55.0missing{\n "num_gpu": 99\n}missing
4090Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181914__95110.08.044170[372, 116]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181914__951.json55.0missing{\n "num_gpu": 99\n}missing
4091Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181818__68810.012.45530[369, 203]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181818__688.json55.0missing{\n "num_gpu": 99\n}missing
4092Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181832__40100.014.26930[369, 228]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181832__401.json50.0missing{\n "num_gpu": 99\n}missing
4093Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181842__77050.09.194144[369, 133]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181842__770.json100.0missing{\n "num_gpu": 99\n}missing
4094Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121844__83600.05.889660[67, 143]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121844__836.json50.0missing{\n "num_gpu": 99\n}missing
4095Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121851__25430.06.245074[67, 152]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121851__254.json90.0missing{\n "num_gpu": 99\n}missing
4096Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_013322__87830.05.855274[67, 141]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_013322__878.json90.0missing{\n "num_gpu": 99\n}missing
4097Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121836__45910.02.033870[108, 36]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121836__459.json55.0missing{\n "num_gpu": 99\n}missing
4098Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121838__24400.02.007730[108, 35]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121838__244.json50.0missing{\n "num_gpu": 99\n}missing
4099Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_013316__55630.02.383884[108, 45]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_013316__556.json90.0missing{\n "num_gpu": 99\n}missing
4100Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_121827__74610.015.79630[198, 236]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121827__746.json55.0missing{\n "num_gpu": 99\n}missing
4101Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_121834__22600.07.050530[198, 154]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121834__226.json0.0missing{\n "num_gpu": 99\n}missing
4102Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_013313__28330.017.91744[198, 294]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013313__283.json90.0missing{\n "num_gpu": 99\n}missing
4103Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121940__50610.016.04120[375, 356]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121940__506.json55.0missing{\n "num_gpu": 99\n}missing
4104Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_121954__68100.014.04190[375, 306]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121954__681.json25.0missing{\n "num_gpu": 99\n}missing
4105Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013346__97600.013.34960[375, 287]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013346__976.json50.0missing{\n "num_gpu": 99\n}missing
4106Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121916__98010.010.76370[373, 224]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121916__980.json55.0missing{\n "num_gpu": 99\n}missing
4107Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121923__60510.07.279390[373, 136]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121923__605.json55.0missing{\n "num_gpu": 99\n}missing
4108Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013333__65300.010.4210[373, 214]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013333__653.json50.0missing{\n "num_gpu": 99\n}missing
4109Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_000117__74900.06.720734[66, 209]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000117__749.json75.0missing{\n "num_gpu": 99\n}missing
4110Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_000125__87000.07.919290[66, 248]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000125__870.json50.0missing{\n "num_gpu": 99\n}missing
4111Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_000138__57800.012.62770[66, 401]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000138__578.json0.0missing{\n "num_gpu": 99\n}missing
4112Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_000147__26500.08.945190[66, 282]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000147__265.json0.0missing{\n "num_gpu": 99\n}missing
4113Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_000156__78200.09.098510[66, 287]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000156__782.json25.0missing{\n "num_gpu": 99\n}missing
4114Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_000100__93610.01.838670[107, 41]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000100__936.json55.0missing{\n "num_gpu": 99\n}missing
4115Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_000105__21610.04.18420[107, 120]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000105__216.json55.0missing{\n "num_gpu": 99\n}missing
4116Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_000107__49400.01.79230[107, 40]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000107__494.json0.0missing{\n "num_gpu": 99\n}missing
4117Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_000108__36100.01.81990[107, 41]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000108__361.json0.0missing{\n "num_gpu": 99\n}missing
4118Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_000110__10600.01.981610[107, 46]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000110__106.json50.0missing{\n "num_gpu": 99\n}missing
4119Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_000018__11100.012.72390[197, 355]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000018__111.json0.0missing{\n "num_gpu": 99\n}missing
4120Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_000029__68900.010.68990[197, 315]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000029__689.json25.0missing{\n "num_gpu": 99\n}missing
4121Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_000040__69500.011.10024[197, 324]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000040__695.json75.0missing{\n "num_gpu": 99\n}missing
4122Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_000050__24600.010.0160[197, 293]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000050__246.json50.0missing{\n "num_gpu": 99\n}missing
4123Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_000058__41500.08.467030[197, 243]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000058__415.json0.0missing{\n "num_gpu": 99\n}missing
4124Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000305__61320.08.053534[374, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000305__613.json85.0missing{\n "num_gpu": 99\n}missing
4125Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000317__98500.011.48260[374, 309]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000317__985.json50.0missing{\n "num_gpu": 99\n}missing
4126Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000327__41710.010.44180[374, 277]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000327__417.json55.0missing{\n "num_gpu": 99\n}missing
4127Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_000337__84900.09.67490[374, 253]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000337__849.json0.0missing{\n "num_gpu": 99\n}missing
4128Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000351__91000.014.17060[374, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000351__910.json50.0missing{\n "num_gpu": 99\n}missing
4129Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000206__87500.09.841950[372, 258]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000206__875.json50.0missing{\n "num_gpu": 99\n}missing
4130Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000221__87040.015.39974[372, 429]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000221__870.json95.0missing{\n "num_gpu": 99\n}missing
4131Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000236__78300.014.06830[372, 389]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000236__783.json50.0missing{\n "num_gpu": 99\n}missing
4132Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231228_000246__33500.010.66770[372, 284]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000246__335.json0.0missing{\n "num_gpu": 99\n}missing
4133Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000257__56000.010.57360[372, 280]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000257__560.json50.0missing{\n "num_gpu": 99\n}missing
4134Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000536__99900.08.16740[66, 200]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000536__999.json50.0missing{\n "num_gpu": 99\n}missing
4135Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_000544__68300.07.376350[66, 180]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000544__683.json0.0missing{\n "num_gpu": 99\n}missing
4136Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000553__10800.09.614190[66, 238]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000553__108.json50.0missing{\n "num_gpu": 99\n}missing
4137Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000603__75900.09.357210[66, 231]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000603__759.json50.0missing{\n "num_gpu": 99\n}missing
4138Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000611__70300.08.122830[66, 199]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000611__703.json50.0missing{\n "num_gpu": 99\n}missing
4139Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000514__10800.03.091530[107, 63]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000514__108.json50.0missing{\n "num_gpu": 99\n}missing
4140Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000519__44110.04.959160[107, 112]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000519__441.json55.0missing{\n "num_gpu": 99\n}missing
4141Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000522__62800.02.980890[107, 60]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000522__628.json50.0missing{\n "num_gpu": 99\n}missing
4142Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000525__17400.02.936680[107, 59]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000525__174.json50.0missing{\n "num_gpu": 99\n}missing
4143Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000528__32500.03.012480[107, 61]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000528__325.json50.0missing{\n "num_gpu": 99\n}missing
4144Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_000404__56200.012.89390[197, 280]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000404__562.json50.0missing{\n "num_gpu": 99\n}missing
4145Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_000422__47110.018.13390[197, 432]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000422__471.json55.0missing{\n "num_gpu": 99\n}missing
4146Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_000439__62700.016.40790[197, 389]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000439__627.json0.0missing{\n "num_gpu": 99\n}missing
4147Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_000452__10900.012.88660[197, 301]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000452__109.json0.0missing{\n "num_gpu": 99\n}missing
4148Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_000510__18530.018.68994[197, 446]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000510__185.json90.0missing{\n "num_gpu": 99\n}missing
4149Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000729__36800.011.26890[374, 234]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000729__368.json50.0missing{\n "num_gpu": 99\n}missing
4150Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000759__73010.029.96570[374, 687]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000759__730.json55.0missing{\n "num_gpu": 99\n}missing
4151Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000815__48100.015.88550[374, 348]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000815__481.json50.0missing{\n "num_gpu": 99\n}missing
4152Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231228_000827__77900.011.86080[374, 249]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000827__779.json0.0missing{\n "num_gpu": 99\n}missing
4153Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000841__81600.013.77850[374, 296]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000841__816.json50.0missing{\n "num_gpu": 99\n}missing
4154Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000625__82200.013.57430[372, 291]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000625__822.json50.0missing{\n "num_gpu": 99\n}missing
4155Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000640__28800.015.18640[372, 331]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000640__288.json50.0missing{\n "num_gpu": 99\n}missing
4156Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000654__86300.014.21430[372, 307]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000654__863.json50.0missing{\n "num_gpu": 99\n}missing
4157Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000704__98100.09.81810[372, 198]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000704__981.json50.0missing{\n "num_gpu": 99\n}missing
4158Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000718__52610.013.59640[372, 292]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000718__526.json55.0missing{\n "num_gpu": 99\n}missing
4159Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122745__87000.013.62630[66, 249]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122745__870.json50.0missing{\n "num_gpu": 99\n}missing
4160Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_122758__36300.013.15370[66, 240]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122758__363.json0.0missing{\n "num_gpu": 99\n}missing
4161Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231227_013550__30100.013.06020[66, 238]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_013550__301.json0.0missing{\n "num_gpu": 99\n}missing
4162Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_122728__71400.03.13030[107, 46]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122728__714.json50.0missing{\n "num_gpu": 99\n}missing
4163Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_122731__65800.03.015690[107, 44]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122731__658.json50.0missing{\n "num_gpu": 99\n}missing
4164Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_013537__27600.07.869990[107, 136]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_013537__276.json50.0missing{\n "num_gpu": 99\n}missing
4165Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122701__73210.011.60194[197, 196]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122701__732.json80.0missing{\n "num_gpu": 99\n}missing
4166Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122724__19410.023.52794[197, 417]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122724__194.json80.0missing{\n "num_gpu": 99\n}missing
4167Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_013529__73630.031.21664[197, 397]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013529__736.json90.0missing{\n "num_gpu": 99\n}missing
4168Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122922__42600.019.92790[374, 330]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122922__426.json50.0missing{\n "num_gpu": 99\n}missing
4169Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122941__99200.018.67260[374, 307]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122941__992.json50.0missing{\n "num_gpu": 99\n}missing
4170Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_013632__72610.019.76444[374, 326]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013632__726.json80.0missing{\n "num_gpu": 99\n}missing
4171Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122845__71500.018.89850[372, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122845__715.json50.0missing{\n "num_gpu": 99\n}missing
4172Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122902__30600.016.91560[372, 275]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122902__306.json50.0missing{\n "num_gpu": 99\n}missing
4173Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231227_013612__58400.022.18350[372, 370]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_013612__584.json50.0missing{\n "num_gpu": 99\n}missing
4174Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_122745__85710.058.88550[71, 344]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_122745__857.json55.0missing{\n "num_gpu": 99\n}missing
4175Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_122826__42750.040.54834[71, 237]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_122826__427.json100.0missing{\n "num_gpu": 99\n}missing
4176Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_122849__31800.022.52820[71, 126]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_122849__318.json50.0missing{\n "num_gpu": 99\n}missing
4177Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_153501__74350.050.29374[71, 295]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_153501__743.json100.0missing{\n "num_gpu": 99\n}missing
4178Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_153539__35910.037.51140[71, 205]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_153539__359.json55.0missing{\n "num_gpu": 99\n}missing
4179Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_122614__44600.012.18890[110, 53]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_122614__446.json0.0missing{\n "num_gpu": 99\n}missing
4180Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_122630__10300.016.7780[110, 80]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_122630__103.json0.0missing{\n "num_gpu": 99\n}missing
4181Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_122646__38000.016.19730[110, 74]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_122646__380.json0.0missing{\n "num_gpu": 99\n}missing
4182Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_153343__11100.09.550220[110, 40]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_153343__111.json0.0missing{\n "num_gpu": 99\n}missing
4183Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_153410__84550.027.2174[110, 149]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_153410__845.json100.0missing{\n "num_gpu": 99\n}missing
4184Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_122353__26800.064.74920[200, 305]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122353__268.json25.0missing{\n "num_gpu": 99\n}missing
4185Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_122441__80900.048.14430[200, 244]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122441__809.json0.0missing{\n "num_gpu": 99\n}missing
4186Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_122601__39750.079.72524[200, 419]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122601__397.json100.0missing{\n "num_gpu": 99\n}missing
4187Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_153234__75010.055.62980[200, 305]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_153234__750.json55.0missing{\n "num_gpu": 99\n}missing
4188Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_153333__89300.059.52870[200, 328]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_153333__893.json50.0missing{\n "num_gpu": 99\n}missing
4189Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_123146__80400.034.65434[384, 151]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123146__804.json75.0missing{\n "num_gpu": 99\n}missing
4190Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_123156__10900.010.24730[384, 4]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123156__109.json0.0missing{\n "num_gpu": 99\n}missing
4191Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_123326__21850.090.1094[384, 477]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123326__218.json100.0missing{\n "num_gpu": 99\n}missing
4192Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_153751__29700.010.4330[384, 4]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153751__297.json0.0missing{\n "num_gpu": 99\n}missing
4193Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_153824__97100.033.20010[384, 141]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153824__971.json0.0missing{\n "num_gpu": 99\n}missing
4194Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_122951__97630.061.79024[382, 312]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_122951__976.json90.0missing{\n "num_gpu": 99\n}missing
4195Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_123037__57510.045.72930[382, 217]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_123037__575.json55.0missing{\n "num_gpu": 99\n}missing
4196Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_123111__66250.034.29414[382, 149]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_123111__662.json100.0missing{\n "num_gpu": 99\n}missing
4197Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_153612__39310.032.78570[382, 138]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_153612__393.json55.0missing{\n "num_gpu": 99\n}missing
4198Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_153740__68210.088.09050[382, 457]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_153740__682.json55.0missing{\n "num_gpu": 99\n}missing
4199Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_122038__54130.06.537784[75, 159]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_122038__541.json90.0missing{\n "num_gpu": 99\n}missing
4200Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_122045__59300.07.103824[75, 174]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_122045__593.json75.0missing{\n "num_gpu": 99\n}missing
4201Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_013414__23800.06.641980[75, 161]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_013414__238.json50.0missing{\n "num_gpu": 99\n}missing
4202Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_122029__21000.04.773290[116, 108]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_122029__210.json50.0missing{\n "num_gpu": 99\n}missing
4203Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_122031__69410.02.352630[116, 44]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_122031__694.json55.0missing{\n "num_gpu": 99\n}missing
4204Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_013407__59930.03.685044[116, 79]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_013407__599.json90.0missing{\n "num_gpu": 99\n}missing
4205Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_122015__57400.020.80950[206, 343]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122015__574.json50.0missing{\n "num_gpu": 99\n}missing
4206Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_122024__65410.09.137780[206, 207]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122024__654.json55.0missing{\n "num_gpu": 99\n}missing
4207Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_013403__53500.017.30260[206, 263]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013403__535.json25.0missing{\n "num_gpu": 99\n}missing
4208Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_122134__14010.011.62930[383, 245]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122134__140.json55.0missing{\n "num_gpu": 99\n}missing
4209Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_122147__30410.011.99150[383, 253]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122147__304.json55.0missing{\n "num_gpu": 99\n}missing
4210Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013443__36910.014.18490[383, 307]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013443__369.json55.0missing{\n "num_gpu": 99\n}missing
4211Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_122111__95650.013.01214[381, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_122111__956.json100.0missing{\n "num_gpu": 99\n}missing
4212Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_122123__29200.011.82150[381, 250]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_122123__292.json25.0missing{\n "num_gpu": 99\n}missing
4213Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013429__39810.014.78920[381, 322]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013429__398.json55.0missing{\n "num_gpu": 99\n}missing
4214Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruefalse520231214_075323__88300.012.05690[69, 359]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_075323__883.json25.0missingmissingmissing
4215Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_114216__26950.05.599874[73, 176]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_114216__269.json100.0missing{\n "num_gpu": 99\n}missing
4216Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_114227__70610.011.47620[73, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_114227__706.json55.0missing{\n "num_gpu": 99\n}missing
4217Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruetrue520231227_011645__52350.08.737984[73, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_011645__523.json100.0missing{\n "num_gpu": 99\n}missing
4218Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_075311__71710.08.98480[98, 258]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_075311__717.json55.0missingmissingmissing
4219Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231225_114205__23900.02.55450[114, 67]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_114205__239.json0.0missing{\n "num_gpu": 99\n}missing
4220Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_114210__65750.05.195154[114, 157]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_114210__657.json100.0missing{\n "num_gpu": 99\n}missing
4221Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_011636__19450.04.220624[114, 123]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_011636__194.json100.0missing{\n "num_gpu": 99\n}missing
4222Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_075302__12500.012.40730[188, 331]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075302__125.json25.0missingmissingmissing
4223Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_114155__85440.015.04084[204, 288]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114155__854.json95.0missing{\n "num_gpu": 99\n}missing
4224Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_114202__91730.07.196314[204, 208]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114202__917.json90.0missing{\n "num_gpu": 99\n}missing
4225Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_011631__17650.014.60134[204, 286]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011631__176.json100.0missing{\n "num_gpu": 99\n}missing
4226Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231214_075409__68000.014.66560[11, 405]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075409__680.json0.0missingmissingmissing
4227Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231225_114303__52300.02.693870[381, 33]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114303__523.json0.0missing{\n "num_gpu": 99\n}missing
4228Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_114311__59550.08.525214[381, 222]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114311__595.json100.0missing{\n "num_gpu": 99\n}missing
4229Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231227_011656__49600.02.557180[381, 28]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011656__496.json0.0missing{\n "num_gpu": 99\n}missing
4230Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231214_075354__65200.021.16720[369, 493]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_075354__652.json50.0missingmissingmissing
4231Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_114246__27150.07.848824[379, 201]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_114246__271.json100.0missing{\n "num_gpu": 99\n}missing
4232Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_114300__74450.013.57534[379, 383]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_114300__744.json100.0missing{\n "num_gpu": 99\n}missing
4233Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_011653__51850.08.462814[379, 219]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_011653__518.json100.0missing{\n "num_gpu": 99\n}missing
4234Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruefalse520231214_080220__84400.010.69570[69, 319]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231214_080220__844.json25.0missingmissingmissing
4235Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruetrue520231225_115903__34630.010.32014[72, 184]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231225_115903__346.json90.0missing{\n "num_gpu": 99\n}missing
4236Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruetrue520231225_115913__58930.09.800384[72, 174]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231225_115913__589.json90.0missing{\n "num_gpu": 99\n}missing
4237Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruetrue520231227_012452__17600.010.49620[72, 186]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231227_012452__176.json50.0missing{\n "num_gpu": 99\n}missing
4238Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTtruefalse520231214_080209__44900.06.831980[98, 193]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_080209__449.json25.0missingmissingmissing
4239Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_115843__53600.04.546590[111, 68]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_115843__536.json0.0missing{\n "num_gpu": 99\n}missing
4240Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_115853__19100.09.973660[111, 172]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_115853__191.json0.0missing{\n "num_gpu": 99\n}missing
4241Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTtruetrue520231227_012442__44030.09.191854[111, 156]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_012442__440.json90.0missing{\n "num_gpu": 99\n}missing
4242Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_080202__31550.012.77314[188, 341]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080202__315.json100.0missingmissingmissing
4243Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_115820__13630.029.41974[201, 341]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115820__136.json90.0missing{\n "num_gpu": 99\n}missing
4244Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_115838__45600.017.90230[201, 303]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115838__456.json50.0missing{\n "num_gpu": 99\n}missing
4245Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231227_012432__95800.041.70040[201, 566]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012432__958.json50.0missing{\n "num_gpu": 99\n}missing
4246Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231214_080315__27200.020.24660[11, 549]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080315__272.json25.0missingmissingmissing
4247Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_120050__95900.039.45560[375, 645]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120050__959.json50.0missing{\n "num_gpu": 99\n}missing
4248Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_120114__45300.023.43650[375, 370]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120114__453.json0.0missing{\n "num_gpu": 99\n}missing
4249Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_012521__95100.012.76350[375, 178]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012521__951.json0.0missing{\n "num_gpu": 99\n}missing
4250Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTtruetrue520231214_080255__61000.024.24770[369, 572]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_080255__610.json50.0missingmissingmissing
4251Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTtruetrue520231225_115950__57000.012.8690[372, 181]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_115950__570.json50.0missing{\n "num_gpu": 99\n}missing
4252Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_120010__85800.019.97410[372, 309]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_120010__858.json0.0missing{\n "num_gpu": 99\n}missing
4253Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTtruetrue520231227_012508__51510.015.64590[372, 230]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_012508__515.json55.0missing{\n "num_gpu": 99\n}missing
4254Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_122243__49200.015.41930[65, 592]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_122243__492.json0.0missing{\n "num_gpu": 99\n}missing
4255Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_122244__85900.01.408730[65, 48]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_122244__859.json0.0missing{\n "num_gpu": 99\n}missing
4256Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_013451__66400.02.359110[65, 86]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_013451__664.json0.0missing{\n "num_gpu": 99\n}missing
4257Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_122211__32400.018.1380[102, 681]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_122211__324.json0.0missing{\n "num_gpu": 99\n}missing
4258Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_122227__81800.016.1590[102, 611]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_122227__818.json0.0missing{\n "num_gpu": 99\n}missing
4259Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_013449__99300.01.391270[102, 43]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_013449__993.json0.0missing{\n "num_gpu": 99\n}missing
4260Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_122151__63500.04.419180[190, 8]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122151__635.json0.0missing{\n "num_gpu": 99\n}missing
4261Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_122153__48100.01.66720[190, 45]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122153__481.json0.0missing{\n "num_gpu": 99\n}missing
4262Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_013448__49800.04.416910[190, 8]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013448__498.json0.0missing{\n "num_gpu": 99\n}missing
4263Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_122329__61900.01.214240[354, 1]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122329__619.json0.0missing{\n "num_gpu": 99\n}missing
4264Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_122330__64300.01.228920[354, 1]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122330__643.json0.0missing{\n "num_gpu": 99\n}missing
4265Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_013458__70200.01.216670[354, 1]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013458__702.json0.0missing{\n "num_gpu": 99\n}missing
4266Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_122325__66700.05.627830[351, 173]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_122325__667.json0.0missing{\n "num_gpu": 99\n}missing
4267Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_122328__69200.02.452680[351, 52]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_122328__692.json0.0missing{\n "num_gpu": 99\n}missing
4268Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_013457__10600.05.218910[351, 157]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_013457__106.json0.0missing{\n "num_gpu": 99\n}missing
4269Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruefalse520231214_080352__89600.010.56650[69, 316]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_080352__896.json25.0missingmissingmissing
4270Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_120347__37730.034.55674[80, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_120347__377.json90.0missing{\n "num_gpu": 99\n}missing
4271Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_120429__33930.041.70464[80, 325]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_120429__339.json90.0missing{\n "num_gpu": 99\n}missing
4272Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_012725__14450.029.39914[80, 223]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_012725__144.json100.0missing{\n "num_gpu": 99\n}missing
4273Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_080342__88710.09.602260[98, 276]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_080342__887.json55.0missingmissingmissing
4274Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_120305__80330.018.97464[119, 135]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_120305__803.json90.0missing{\n "num_gpu": 99\n}missing
4275Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_120313__21430.07.30034[119, 39]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_120313__214.json90.0missing{\n "num_gpu": 99\n}missing
4276Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_012656__66100.043.82574[119, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_012656__661.json75.0missing{\n "num_gpu": 99\n}missing
4277Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231214_080332__51720.016.86684[188, 455]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080332__517.json85.0missingmissingmissing
4278Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_120211__66330.057.83744[209, 256]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120211__663.json90.0missing{\n "num_gpu": 99\n}missing
4279Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_120246__10030.034.57054[209, 244]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120246__100.json90.0missing{\n "num_gpu": 99\n}missing
4280Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231227_012612__64900.051.21410[209, 210]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012612__649.json0.0missing{\n "num_gpu": 99\n}missing
4281Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_080421__82400.01.337740[11, 33]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080421__824.json0.0missingmissingmissing
4282Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231225_120701__68400.022.20760[383, 115]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120701__684.json25.0missing{\n "num_gpu": 99\n}missing
4283Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_120751__36230.049.89224[383, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120751__362.json90.0missing{\n "num_gpu": 99\n}missing
4284Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_012833__52500.037.1690[383, 232]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012833__525.json50.0missing{\n "num_gpu": 99\n}missing
4285Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_080420__58110.016.85920[369, 380]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_080420__581.json55.0missingmissingmissing
4286Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_120551__19230.046.04774[380, 303]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_120551__192.json90.0missing{\n "num_gpu": 99\n}missing
4287Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_120638__49530.047.0564[380, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_120638__495.json90.0missing{\n "num_gpu": 99\n}missing
4288Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_012756__23730.030.47194[380, 180]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_012756__237.json90.0missing{\n "num_gpu": 99\n}missing
4289Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_121615__29410.015.82220[75, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_121615__294.json55.0missing{\n "num_gpu": 99\n}missing
4290Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_121627__96250.011.85054[75, 197]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_121627__962.json100.0missing{\n "num_gpu": 99\n}missing
4291Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231227_013215__19400.013.65220[75, 228]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_013215__194.json0.0missing{\n "num_gpu": 99\n}missing
4292Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121545__79230.013.85654[116, 227]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121545__792.json90.0missing{\n "num_gpu": 99\n}missing
4293Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121559__18810.014.06930[116, 231]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121559__188.json55.0missing{\n "num_gpu": 99\n}missing
4294Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_013201__51400.013.04670[116, 212]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_013201__514.json50.0missing{\n "num_gpu": 99\n}missing
4295Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_121515__62710.027.82380[206, 294]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121515__627.json55.0missing{\n "num_gpu": 99\n}missing
4296Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_121531__57600.016.04360[206, 250]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121531__576.json0.0missing{\n "num_gpu": 99\n}missing
4297Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_013148__75700.023.10940[206, 226]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013148__757.json0.0missing{\n "num_gpu": 99\n}missing
4298Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121749__96810.022.6780[383, 336]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121749__968.json55.0missing{\n "num_gpu": 99\n}missing
4299Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121811__74710.021.67390[383, 319]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121811__747.json55.0missing{\n "num_gpu": 99\n}missing
4300Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013255__15150.015.18884[383, 209]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013255__151.json100.0missing{\n "num_gpu": 99\n}missing
4301Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121705__83850.015.55064[381, 216]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121705__838.json100.0missing{\n "num_gpu": 99\n}missing
4302Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_121727__22400.021.06420[381, 309]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121727__224.json25.0missing{\n "num_gpu": 99\n}missing
4303Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013240__19810.024.82470[381, 370]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013240__198.json55.0missing{\n "num_gpu": 99\n}missing
4304Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruefalse520231214_080055__85100.010.66180[69, 318]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_080055__851.json25.0missingmissingmissing
4305Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruefalse520231225_115719__29300.04.977640[75, 284]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_115719__293.json25.0missing{\n "num_gpu": 99\n}missing
4306Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruetrue520231225_115725__62500.05.112450[75, 291]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_115725__625.json50.0missing{\n "num_gpu": 99\n}missing
4307Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruefalse520231227_012339__17100.05.480430[75, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_012339__171.json25.0missing{\n "num_gpu": 99\n}missing
4308Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_080044__28250.06.170264[98, 172]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_080044__282.json100.0missingmissingmissing
4309Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_115708__26900.01.375960[112, 67]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_115708__269.json0.0missing{\n "num_gpu": 99\n}missing
4310Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_115714__10100.06.074260[112, 340]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_115714__101.json0.0missing{\n "num_gpu": 99\n}missing
4311Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_012334__87200.04.828180[112, 267]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_012334__872.json0.0missing{\n "num_gpu": 99\n}missing
4312Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_080038__28810.018.12340[188, 489]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080038__288.json55.0missingmissingmissing
4313Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_115704__31700.06.110640[197, 173]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115704__317.json0.0missing{\n "num_gpu": 99\n}missing
4314Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231225_115707__68100.03.400530[197, 168]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115707__681.json25.0missing{\n "num_gpu": 99\n}missing
4315Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_012329__16700.011.15610[197, 439]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012329__167.json0.0missing{\n "num_gpu": 99\n}missing
4316Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231214_080149__30300.022.24930[11, 599]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080149__303.json25.0missingmissingmissing
4317Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_115746__48700.05.75090[362, 254]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115746__487.json25.0missing{\n "num_gpu": 99\n}missing
4318Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_115751__80200.05.300940[362, 233]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115751__802.json0.0missing{\n "num_gpu": 99\n}missing
4319Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231227_012351__54500.05.770680[362, 257]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012351__545.json50.0missing{\n "num_gpu": 99\n}missing
4320Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_080127__18800.023.620[369, 555]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_080127__188.json50.0missingmissingmissing
4321Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_115735__92300.04.590240[360, 188]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_115735__923.json25.0missing{\n "num_gpu": 99\n}missing
4322Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_115740__28400.04.940260[360, 213]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_115740__284.json25.0missing{\n "num_gpu": 99\n}missing
4323Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231227_012345__39200.05.324640[360, 234]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_012345__392.json25.0missing{\n "num_gpu": 99\n}missing
4324Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruefalse520231214_075436__54100.09.907120[69, 295]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_075436__541.json25.0missingmissingmissing
4325Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruetrue520231225_114412__64320.08.554794[75, 274]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_114412__643.json85.0missing{\n "num_gpu": 99\n}missing
4326Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruetrue520231225_114417__31210.04.70010[75, 144]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_114417__312.json55.0missing{\n "num_gpu": 99\n}missing
4327Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruetrue520231227_011727__39210.06.602040[75, 208]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_011727__392.json55.0missing{\n "num_gpu": 99\n}missing
4328Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_075426__29320.07.265524[98, 205]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_075426__293.json85.0missingmissingmissing
4329Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_114355__29010.08.655110[116, 272]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_114355__290.json55.0missing{\n "num_gpu": 99\n}missing
4330Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_114403__88620.07.697264[116, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_114403__886.json85.0missing{\n "num_gpu": 99\n}missing
4331Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_011720__31310.06.005220[116, 182]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_011720__313.json55.0missing{\n "num_gpu": 99\n}missing
4332Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231214_075419__42310.010.03510[188, 263]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075419__423.json55.0missingmissingmissing
4333Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_114332__50550.020.75294[206, 472]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114332__505.json100.0missing{\n "num_gpu": 99\n}missing
4334Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_114346__13750.014.34724[206, 439]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114346__137.json100.0missing{\n "num_gpu": 99\n}missing
4335Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_011714__12350.018.15284[206, 394]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011714__123.json100.0missing{\n "num_gpu": 99\n}missing
4336Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_075516__78900.010.16560[11, 283]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075516__789.json0.0missingmissingmissing
4337Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_114456__60320.09.281174[383, 246]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114456__603.json85.0missing{\n "num_gpu": 99\n}missing
4338Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_114506__91510.09.74610[383, 261]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114506__915.json55.0missing{\n "num_gpu": 99\n}missing
4339Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_011755__64010.09.169010[383, 241]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011755__640.json55.0missing{\n "num_gpu": 99\n}missing
4340Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_075506__42310.019.40930[369, 447]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_075506__423.json55.0missingmissingmissing
4341Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_114439__58810.010.49160[381, 284]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_114439__588.json55.0missing{\n "num_gpu": 99\n}missing
4342Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_114447__15150.07.19254[381, 179]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_114447__151.json100.0missing{\n "num_gpu": 99\n}missing
4343Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231227_011746__92500.018.95190[381, 544]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_011746__925.json25.0missing{\n "num_gpu": 99\n}missing
4344Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruefalse520231214_075539__86800.09.751060[69, 291]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_075539__868.json25.0missingmissingmissing
4345Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruetrue520231225_114804__47610.070.69030[71, 536]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_114804__476.json55.0missing{\n "num_gpu": 99\n}missing
4346Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruefalse520231225_114848__70000.043.50710[71, 328]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_114848__700.json25.0missing{\n "num_gpu": 99\n}missing
4347Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruetrue520231227_011947__67710.058.50350[71, 441]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_011947__677.json55.0missing{\n "num_gpu": 99\n}missing
4348Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231214_075529__29200.07.707360[98, 220]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_075529__292.json25.0missingmissingmissing
4349Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_114629__36550.07.109414[110, 36]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_114629__365.json100.0missing{\n "num_gpu": 99\n}missing
4350Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_114654__22110.023.88520[110, 169]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_114654__221.json55.0missing{\n "num_gpu": 99\n}missing
4351Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_011848__59950.014.30994[110, 93]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_011848__599.json100.0missing{\n "num_gpu": 99\n}missing
4352Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231214_075522__50300.05.576920[188, 130]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075522__503.json0.0missingmissingmissing
4353Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_114552__74310.045.60224[200, 139]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114552__743.json80.0missing{\n "num_gpu": 99\n}missing
4354Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_114622__10250.030.52974[200, 204]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114622__102.json100.0missing{\n "num_gpu": 99\n}missing
4355Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231227_011834__85700.038.62920[200, 92]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011834__857.json25.0missing{\n "num_gpu": 99\n}missing
4356Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_075622__35000.016.24840[11, 445]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075622__350.json50.0missingmissingmissing
4357Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_115110__62610.015.45740[384, 59]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115110__626.json55.0missing{\n "num_gpu": 99\n}missing
4358Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_115209__11450.059.13564[384, 388]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115209__114.json100.0missing{\n "num_gpu": 99\n}missing
4359Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231227_012139__67700.063.09620[384, 416]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012139__677.json50.0missing{\n "num_gpu": 99\n}missing
4360Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_075606__26610.019.30830[369, 444]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_075606__266.json55.0missingmissingmissing
4361Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_115020__15250.036.92084[382, 222]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_115020__152.json100.0missing{\n "num_gpu": 99\n}missing
4362Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_115055__16400.034.25840[382, 202]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_115055__164.json50.0missing{\n "num_gpu": 99\n}missing
4363Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruefalse520231227_012035__15400.048.21870[382, 306]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_012035__154.json25.0missing{\n "num_gpu": 99\n}missing
4364Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTtruefalse520231214_081254__78500.016.72850[70, 493]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_081254__785.json25.0missingmissingmissing
4365Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTfalsefalse520231225_125019__72500.025.7120[78, 473]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_125019__725.json0.0missing{\n "num_gpu": 99\n}missing
4366Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTtruetrue520231225_125047__53910.028.21692[78, 518]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_125047__539.json67.5missing{\n "num_gpu": 99\n}missing
4367Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTtruetrue520231227_015034__56300.024.84720[78, 450]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_015034__563.json50.0missing{\n "num_gpu": 99\n}missing
4368Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_081237__35900.018.98570[99, 544]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_081237__359.json50.0missingmissingmissing
4369Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231225_124935__41400.018.74630[116, 338]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_124935__414.json25.0missing{\n "num_gpu": 99\n}missing
4370Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231225_124953__38300.017.34740[116, 312]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_124953__383.json25.0missing{\n "num_gpu": 99\n}missing
4371Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_014809__33800.012.92041[116, 227]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_014809__338.json56.25missing{\n "num_gpu": 99\n}missing
4372Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231214_081218__58400.020.69790[187, 558]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081218__584.json25.0missingmissingmissing
4373Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231225_124855__28800.042.05220[205, 564]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_124855__288.json25.0missing{\n "num_gpu": 99\n}missing
4374Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231225_124917__50300.022.0410[205, 380]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_124917__503.json25.0missing{\n "num_gpu": 99\n}missing
4375Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231227_014756__21300.042.10650[205, 568]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_014756__213.json25.0missing{\n "num_gpu": 99\n}missing
4376Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_081406__11900.021.10320[11, 570]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081406__119.json50.0missingmissingmissing
4377Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_125232__99300.020.86333[381, 326]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125232__993.json68.75missing{\n "num_gpu": 99\n}missing
4378Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231225_125307__92800.033.93360[381, 546]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125307__928.json25.0missing{\n "num_gpu": 99\n}missing
4379Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_015125__15000.023.99870[381, 379]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015125__150.json50.0missing{\n "num_gpu": 99\n}missing
4380Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231214_081344__32900.029.27690[370, 694]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_081344__329.json25.0missingmissingmissing
4381Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_125156__59500.030.45160[378, 494]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_125156__595.json50.0missing{\n "num_gpu": 99\n}missing
4382Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_125211__96300.014.8190[378, 217]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_125211__963.json50.0missing{\n "num_gpu": 99\n}missing
4383Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231227_015101__83900.026.29850[378, 419]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_015101__839.json25.0missing{\n "num_gpu": 99\n}missing
4384Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonInJulia1SHOTtruefalse520231214_081457__12600.013.84920[70, 411]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_081457__126.json25.0missingmissingmissing
4385Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonInJulia1SHOTfalsefalse520231225_125408__19600.020.39850[52, 377]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_125408__196.json0.0missing{\n "num_gpu": 99\n}missing
4386Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonInJulia1SHOTfalsefalse520231225_125448__62200.039.80910[52, 720]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_125448__622.json0.0missing{\n "num_gpu": 99\n}missing
4387Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_081443__68000.018.34410[99, 526]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_081443__680.json0.0missingmissingmissing
4388Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_125323__49200.01.609760[53, 20]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_125323__492.json0.0missing{\n "num_gpu": 99\n}missing
4389Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_125348__33800.024.62560[53, 450]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_125348__338.json0.0missing{\n "num_gpu": 99\n}missing
4390Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231214_081424__91600.018.66040[187, 504]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081424__916.json0.0missingmissingmissing
4391Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_125319__14000.012.35960[80, 28]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125319__140.json0.0missing{\n "num_gpu": 99\n}missing
4392Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_125321__91600.02.005120[80, 23]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125321__916.json0.0missing{\n "num_gpu": 99\n}missing
4393Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_081606__12200.023.91250[11, 640]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081606__122.json50.0missingmissingmissing
4394Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_125527__29700.01.375850[70, 11]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125527__297.json0.0missing{\n "num_gpu": 99\n}missing
4395Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_125530__31100.03.096350[70, 43]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125530__311.json0.0missing{\n "num_gpu": 99\n}missing
4396Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231214_081542__81400.022.92110[370, 537]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_081542__814.json25.0missingmissingmissing
4397Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_125522__43800.03.600020[67, 54]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_125522__438.json25.0missing{\n "num_gpu": 99\n}missing
4398Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_125525__63300.03.646210[67, 55]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_125525__633.json0.0missing{\n "num_gpu": 99\n}missing
4399Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_133915__19900.050.91740[67, 308]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_133915__199.json50.0missing{\n "num_gpu": 99\n}missing
4400Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_134006__60300.050.60240[67, 306]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_134006__603.json25.0missing{\n "num_gpu": 99\n}missing
4401Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_020752__37300.054.7590[67, 331]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_020752__373.json50.0missing{\n "num_gpu": 99\n}missing
4402Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_133700__10800.070.37170[108, 422]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_133700__108.json50.0missing{\n "num_gpu": 99\n}missing
4403Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_133823__15940.082.86593[108, 498]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_133823__159.json88.75missing{\n "num_gpu": 99\n}missing
4404Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_020656__42230.047.8452[108, 283]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_020656__422.json77.5missing{\n "num_gpu": 99\n}missing
4405Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_133508__56820.083.08872[197, 322]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_133508__568.json72.5missing{\n "num_gpu": 99\n}missing
4406Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_133550__55100.041.63440[197, 228]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_133550__551.json25.0missing{\n "num_gpu": 99\n}missing
4407Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_020609__96200.079.8690[197, 317]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_020609__962.json25.0missing{\n "num_gpu": 99\n}missing
4408Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_134740__98300.071.63210[396, 376]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_134740__983.json25.0missing{\n "num_gpu": 99\n}missing
4409Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_134848__15220.068.59642[396, 358]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_134848__152.json72.5missing{\n "num_gpu": 99\n}missing
4410Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_021005__23500.044.58880[396, 213]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021005__235.json25.0missing{\n "num_gpu": 99\n}missing
4411Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_134515__64100.088.14330[394, 474]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_134515__641.json25.0missing{\n "num_gpu": 99\n}missing
4412Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_134628__35300.071.69730[394, 376]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_134628__353.json25.0missing{\n "num_gpu": 99\n}missing
4413Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_020920__51530.088.19292[394, 474]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_020920__515.json77.5missing{\n "num_gpu": 99\n}missing
4414Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_022003__36700.011.84220[69, 454]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_022003__367.json0.0missing{\n "num_gpu": 99\n}missing
4415Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_123502__62310.010.90551[69, 420]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_123502__623.json61.25missing{\n "num_gpu": 99\n}missing
4416Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_123513__82300.011.70690[69, 450]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_123513__823.json25.0missing{\n "num_gpu": 99\n}missing
4417Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_123534__67800.020.19830[69, 757]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_123534__678.json0.0missing{\n "num_gpu": 99\n}missing
4418Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_021951__33700.013.60450[106, 513]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_021951__337.json0.0missing{\n "num_gpu": 99\n}missing
4419Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_123422__71300.011.53470[106, 437]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_123422__713.json0.0missing{\n "num_gpu": 99\n}missing
4420Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_123437__85100.015.08820[106, 568]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_123437__851.json0.0missing{\n "num_gpu": 99\n}missing
4421Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_123450__68100.013.66260[106, 516]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_123450__681.json0.0missing{\n "num_gpu": 99\n}missing
4422Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_021938__67100.011.26710[193, 284]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021938__671.json0.0missing{\n "num_gpu": 99\n}missing
4423Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_123340__51200.013.1310[193, 347]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123340__512.json0.0missing{\n "num_gpu": 99\n}missing
4424Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_123357__79400.017.16890[193, 621]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123357__794.json0.0missing{\n "num_gpu": 99\n}missing
4425Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_123410__24800.013.29740[193, 483]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123410__248.json0.0missing{\n "num_gpu": 99\n}missing
4426Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_022028__96900.011.87470[358, 396]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022028__969.json25.0missing{\n "num_gpu": 99\n}missing
4427Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_123652__25000.026.22190[358, 882]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123652__250.json0.0missing{\n "num_gpu": 99\n}missing
4428Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_123704__65700.011.90960[358, 398]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123704__657.json0.0missing{\n "num_gpu": 99\n}missing
4429Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_123719__11400.014.64310[358, 494]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123719__114.json25.0missing{\n "num_gpu": 99\n}missing
4430Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_022016__96300.012.57210[355, 421]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_022016__963.json0.0missing{\n "num_gpu": 99\n}missing
4431Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231227_123555__34500.021.72960[355, 736]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_123555__345.json25.0missing{\n "num_gpu": 99\n}missing
4432Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_123610__55600.014.63530[355, 494]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_123610__556.json0.0missing{\n "num_gpu": 99\n}missing
4433Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231227_123626__31000.015.72510[355, 532]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_123626__310.json25.0missing{\n "num_gpu": 99\n}missing
4434Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTtruefalse520231214_080517__99500.019.0340[70, 557]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231214_080517__995.json25.0missingmissingmissing
4435Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTfalsefalse520231225_122443__73900.016.42810[70, 487]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231225_122443__739.json0.0missing{\n "num_gpu": 99\n}missing
4436Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTtruefalse520231225_122506__94800.022.19890[1, 662]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231225_122506__948.json25.0missing{\n "num_gpu": 99\n}missing
4437Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTtruefalse520231227_013748__21300.014.80030[70, 446]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231227_013748__213.json25.0missing{\n "num_gpu": 99\n}missing
4438Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTtruetrue520231214_080458__47300.016.90590[99, 487]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_080458__473.json50.0missingmissingmissing
4439Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTtruetrue520231225_122416__98300.012.07380[99, 351]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_122416__983.json50.0missing{\n "num_gpu": 99\n}missing
4440Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTfalsefalse520231225_122427__63000.010.91860[1, 338]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_122427__630.json0.0missing{\n "num_gpu": 99\n}missing
4441Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTtruefalse520231227_013733__72700.08.682230[99, 253]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_013733__727.json25.0missing{\n "num_gpu": 99\n}missing
4442Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTtruetrue520231214_080441__51610.019.78831[187, 534]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080441__516.json61.25missingmissingmissing
4443Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTtruetrue520231225_122351__85500.020.23760[205, 407]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122351__855.json50.0missing{\n "num_gpu": 99\n}missing
4444Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_122404__30200.013.20710[1, 394]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122404__302.json0.0missing{\n "num_gpu": 99\n}missing
4445Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTfalsefalse520231227_013724__81400.025.75460[205, 569]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013724__814.json0.0missing{\n "num_gpu": 99\n}missing
4446Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTtruefalse520231214_080609__77500.014.55550[11, 401]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080609__775.json25.0missingmissingmissing
4447Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTtruetrue520231225_122656__55000.022.83020[11, 615]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122656__550.json50.0missing{\n "num_gpu": 99\n}missing
4448Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTtruetrue520231225_122729__11900.033.07910[1, 866]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122729__119.json50.0missing{\n "num_gpu": 99\n}missing
4449Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTfalsefalse520231227_013840__22500.023.44980[11, 637]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013840__225.json0.0missing{\n "num_gpu": 99\n}missing
4450Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231214_080555__92200.019.50640[370, 450]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_080555__922.json0.0missingmissingmissing
4451Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231225_122609__12200.023.91080[370, 565]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_122609__122.json0.0missing{\n "num_gpu": 99\n}missing
4452Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231225_122633__40800.023.42720[1, 636]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_122633__408.json0.0missing{\n "num_gpu": 99\n}missing
4453Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231227_013816__87900.028.28760[370, 680]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_013816__879.json0.0missing{\n "num_gpu": 99\n}missing
4454Apple-MacBook-Pro-M1pig_latinifymagicoderInJulia1SHOTtruefalse520231214_081652__28600.013.57620[70, 404]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__InJulia__1SHOT__20231214_081652__286.json25.0missingmissingmissing
4455Apple-MacBook-Pro-M1pig_latinifymagicoderInJulia1SHOTtruetrue520231225_125643__92220.011.03572[70, 366]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__InJulia__1SHOT__20231225_125643__922.json72.5missing{\n "num_gpu": 99\n}missing
4456Apple-MacBook-Pro-M1pig_latinifymagicoderInJulia1SHOTtruefalse520231227_015705__64800.010.39780[70, 341]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__InJulia__1SHOT__20231227_015705__648.json25.0missing{\n "num_gpu": 99\n}missing
4457Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTtruetrue520231214_081638__25100.014.52111[99, 420]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_081638__251.json56.25missingmissingmissing
4458Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTfalsefalse520231225_125621__66000.011.09390[109, 353]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_125621__660.json0.0missing{\n "num_gpu": 99\n}missing
4459Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTfalsefalse520231225_125632__40900.010.21770[109, 329]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_125632__409.json0.0missing{\n "num_gpu": 99\n}missing
4460Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTfalsefalse520231227_015654__58500.012.65260[109, 408]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_015654__585.json0.0missing{\n "num_gpu": 99\n}missing
4461Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_081623__48500.017.39550[187, 468]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081623__485.json0.0missingmissingmissing
4462Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_125553__63800.023.46370[197, 540]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125553__638.json0.0missing{\n "num_gpu": 99\n}missing
4463Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_125610__35500.017.10990[197, 524]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125610__355.json0.0missing{\n "num_gpu": 99\n}missing
4464Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_015641__30410.016.30822[197, 330]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_015641__304.json67.5missing{\n "num_gpu": 99\n}missing
4465Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTtruefalse520231214_081805__81200.031.59930[11, 824]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081805__812.json25.0missingmissingmissing
4466Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_131537__63810.015.15121[373, 431]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131537__638.json61.25missing{\n "num_gpu": 99\n}missing
4467Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTtruefalse520231225_131553__80500.015.88870[373, 459]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131553__805.json25.0missing{\n "num_gpu": 99\n}missing
4468Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTfalsefalse520231227_015727__98200.011.88630[373, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015727__982.json0.0missing{\n "num_gpu": 99\n}missing
4469Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTfalsefalse520231214_081734__96200.016.62550[370, 374]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_081734__962.json0.0missingmissingmissing
4470Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTtruetrue520231225_131513__54600.011.95242[370, 339]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_131513__546.json62.5missing{\n "num_gpu": 99\n}missing
4471Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTfalsefalse520231225_131522__12000.08.581720[370, 219]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_131522__120.json0.0missing{\n "num_gpu": 99\n}missing
4472Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTtruetrue520231227_015715__17700.010.06991[370, 276]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_015715__177.json56.25missing{\n "num_gpu": 99\n}missing
4473Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_182130__27700.023.73720[70, 447]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182130__277.json25.0missing{\n "num_gpu": 99\n}missing
4474Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_182154__36100.023.95880[70, 460]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182154__361.json25.0missing{\n "num_gpu": 99\n}missing
4475Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_182210__85800.016.29130[70, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182210__858.json25.0missing{\n "num_gpu": 99\n}missing
4476Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_182021__26200.021.62230[109, 412]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182021__262.json25.0missing{\n "num_gpu": 99\n}missing
4477Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182046__95500.024.90381[109, 468]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182046__955.json56.25missing{\n "num_gpu": 99\n}missing
4478Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182106__80010.020.18931[109, 383]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182106__800.json61.25missing{\n "num_gpu": 99\n}missing
4479Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181931__17000.017.60140[197, 305]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181931__170.json25.0missing{\n "num_gpu": 99\n}missing
4480Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181944__44500.012.67110[197, 223]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181944__445.json25.0missing{\n "num_gpu": 99\n}missing
4481Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_181959__10100.015.09330[197, 271]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181959__101.json0.0missing{\n "num_gpu": 99\n}missing
4482Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_182337__43400.014.32720[373, 239]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182337__434.json25.0missing{\n "num_gpu": 99\n}missing
4483Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182401__33500.024.20411[373, 410]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182401__335.json56.25missing{\n "num_gpu": 99\n}missing
4484Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_182421__46800.020.03010[373, 348]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182421__468.json0.0missing{\n "num_gpu": 99\n}missing
4485Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182237__43100.026.84191[370, 472]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182237__431.json56.25missing{\n "num_gpu": 99\n}missing
4486Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182305__30000.027.53921[370, 484]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182305__300.json56.25missing{\n "num_gpu": 99\n}missing
4487Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182322__76100.016.72661[370, 281]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182322__761.json56.25missing{\n "num_gpu": 99\n}missing
4488Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_135534__37400.018.15490[65, 460]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_135534__374.json25.0missing{\n "num_gpu": 99\n}missing
4489Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_135551__31600.016.8741[65, 427]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_135551__316.json56.25missing{\n "num_gpu": 99\n}missing
4490Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_021310__57300.015.0780[65, 379]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_021310__573.json50.0missing{\n "num_gpu": 99\n}missing
4491Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_135509__91110.014.7181[106, 366]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135509__911.json61.25missing{\n "num_gpu": 99\n}missing
4492Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_135516__61600.06.839430[106, 162]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135516__616.json0.0missing{\n "num_gpu": 99\n}missing
4493Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_021255__32910.013.26681[106, 327]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_021255__329.json61.25missing{\n "num_gpu": 99\n}missing
4494Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_135439__51510.025.78981[194, 488]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135439__515.json61.25missing{\n "num_gpu": 99\n}missing
4495Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_135454__67900.014.98560[194, 357]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135454__679.json0.0missing{\n "num_gpu": 99\n}missing
4496Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_021242__98910.019.61221[194, 337]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021242__989.json61.25missing{\n "num_gpu": 99\n}missing
4497Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_135825__87000.083.53420[373, 1876]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135825__870.json25.0missing{\n "num_gpu": 99\n}missing
4498Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_135849__29400.024.16580[373, 555]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135849__294.json25.0missing{\n "num_gpu": 99\n}missing
4499Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_021349__19000.017.8560[373, 398]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021349__190.json50.0missing{\n "num_gpu": 99\n}missing
4500Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_135641__28600.019.45960[371, 440]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135641__286.json50.0missing{\n "num_gpu": 99\n}missing
4501Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_135701__64600.019.98010[371, 453]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135701__646.json0.0missing{\n "num_gpu": 99\n}missing
4502Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_021331__32400.020.77260[371, 469]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_021331__324.json0.0missing{\n "num_gpu": 99\n}missing
4503Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_001149__80300.019.74860[64, 628]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001149__803.json50.0missing{\n "num_gpu": 99\n}missing
4504Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_001205__44700.015.5010[64, 496]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001205__447.json50.0missing{\n "num_gpu": 99\n}missing
4505Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_001219__96700.014.24620[64, 456]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001219__967.json25.0missing{\n "num_gpu": 99\n}missing
4506Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_001238__60700.019.27410[64, 614]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001238__607.json50.0missing{\n "num_gpu": 99\n}missing
4507Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_001255__37000.016.53980[64, 529]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001255__370.json25.0missing{\n "num_gpu": 99\n}missing
4508Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_001031__37600.015.6960[105, 490]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001031__376.json50.0missing{\n "num_gpu": 99\n}missing
4509Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001044__58200.012.60110[105, 393]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001044__582.json25.0missing{\n "num_gpu": 99\n}missing
4510Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001056__59400.012.06630[105, 376]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001056__594.json25.0missing{\n "num_gpu": 99\n}missing
4511Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001111__81300.015.13730[105, 473]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001111__813.json25.0missing{\n "num_gpu": 99\n}missing
4512Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_001129__31900.017.99750[105, 562]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001129__319.json50.0missing{\n "num_gpu": 99\n}missing
4513Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_000902__34000.020.9610[193, 615]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000902__340.json25.0missing{\n "num_gpu": 99\n}missing
4514Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_000924__70500.022.19560[193, 672]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000924__705.json25.0missing{\n "num_gpu": 99\n}missing
4515Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_000946__31800.021.73890[193, 657]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000946__318.json25.0missing{\n "num_gpu": 99\n}missing
4516Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_001003__89900.016.56970[193, 499]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001003__899.json25.0missing{\n "num_gpu": 99\n}missing
4517Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_001016__15400.012.78730[193, 381]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001016__154.json25.0missing{\n "num_gpu": 99\n}missing
4518Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_001448__23700.014.32680[372, 396]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001448__237.json0.0missing{\n "num_gpu": 99\n}missing
4519Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_001511__99600.022.97150[372, 656]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001511__996.json50.0missing{\n "num_gpu": 99\n}missing
4520Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_001537__80400.025.87780[372, 740]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001537__804.json25.0missing{\n "num_gpu": 99\n}missing
4521Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_001558__80000.020.92810[372, 596]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001558__800.json25.0missing{\n "num_gpu": 99\n}missing
4522Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_001614__88600.016.35260[372, 458]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001614__886.json25.0missing{\n "num_gpu": 99\n}missing
4523Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231228_001314__59800.019.4980[370, 553]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001314__598.json25.0missing{\n "num_gpu": 99\n}missing
4524Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_001333__49900.019.12430[370, 542]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001333__499.json50.0missing{\n "num_gpu": 99\n}missing
4525Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231228_001355__54800.021.90580[370, 624]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001355__548.json25.0missing{\n "num_gpu": 99\n}missing
4526Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231228_001415__47900.019.29520[370, 547]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001415__479.json25.0missing{\n "num_gpu": 99\n}missing
4527Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_001434__51800.018.77470[370, 531]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001434__518.json50.0missing{\n "num_gpu": 99\n}missing
4528Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_001946__32410.022.06751[64, 557]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_001946__324.json61.25missing{\n "num_gpu": 99\n}missing
4529Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_002010__14300.023.36970[64, 589]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002010__143.json50.0missing{\n "num_gpu": 99\n}missing
4530Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_002030__93000.020.23470[64, 511]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002030__930.json50.0missing{\n "num_gpu": 99\n}missing
4531Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_002053__49700.022.79490[64, 575]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002053__497.json50.0missing{\n "num_gpu": 99\n}missing
4532Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_002109__52700.015.61460[64, 395]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002109__527.json0.0missing{\n "num_gpu": 99\n}missing
4533Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231228_001817__77400.013.25220[105, 325]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001817__774.json25.0missing{\n "num_gpu": 99\n}missing
4534Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_001840__60200.022.62480[105, 560]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001840__602.json50.0missing{\n "num_gpu": 99\n}missing
4535Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_001855__81500.015.37980[105, 379]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001855__815.json50.0missing{\n "num_gpu": 99\n}missing
4536Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_001909__70700.013.66250[105, 336]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001909__707.json50.0missing{\n "num_gpu": 99\n}missing
4537Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231228_001924__73000.014.93440[105, 368]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001924__730.json0.0missing{\n "num_gpu": 99\n}missing
4538Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_001634__25100.019.50120[193, 446]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001634__251.json25.0missing{\n "num_gpu": 99\n}missing
4539Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_001653__15300.019.16430[193, 458]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001653__153.json50.0missing{\n "num_gpu": 99\n}missing
4540Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_001718__75700.024.62620[193, 592]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001718__757.json0.0missing{\n "num_gpu": 99\n}missing
4541Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_001738__49200.020.26830[193, 485]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001738__492.json25.0missing{\n "num_gpu": 99\n}missing
4542Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_001804__97300.025.82560[193, 621]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001804__973.json50.0missing{\n "num_gpu": 99\n}missing
4543Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_002329__77600.021.66450[372, 489]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002329__776.json50.0missing{\n "num_gpu": 99\n}missing
4544Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_002357__92200.027.19320[372, 621]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002357__922.json25.0missing{\n "num_gpu": 99\n}missing
4545Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_002425__73400.028.78980[372, 659]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002425__734.json50.0missing{\n "num_gpu": 99\n}missing
4546Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_002449__19400.023.12920[372, 524]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002449__194.json25.0missing{\n "num_gpu": 99\n}missing
4547Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_002512__71800.022.9440[372, 520]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002512__718.json25.0missing{\n "num_gpu": 99\n}missing
4548Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_002140__99400.030.6170[370, 702]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002140__994.json25.0missing{\n "num_gpu": 99\n}missing
4549Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_002157__99110.016.94061[370, 374]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002157__991.json61.25missing{\n "num_gpu": 99\n}missing
4550Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_002213__10010.015.52561[370, 339]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002213__100.json61.25missing{\n "num_gpu": 99\n}missing
4551Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_002245__62500.032.07720[370, 736]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002245__625.json50.0missing{\n "num_gpu": 99\n}missing
4552Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_002307__43800.021.96010[370, 496]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002307__438.json0.0missing{\n "num_gpu": 99\n}missing
4553Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_123157__29700.026.94980[64, 501]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123157__297.json50.0missing{\n "num_gpu": 99\n}missing
4554Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_123230__39300.032.32070[64, 600]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123230__393.json50.0missing{\n "num_gpu": 99\n}missing
4555Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_021814__97200.030.78790[64, 570]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_021814__972.json50.0missing{\n "num_gpu": 99\n}missing
4556Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_123106__25600.021.1950[105, 386]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123106__256.json0.0missing{\n "num_gpu": 99\n}missing
4557Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231226_123131__56400.024.33660[105, 445]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123131__564.json25.0missing{\n "num_gpu": 99\n}missing
4558Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_021743__18300.018.57460[105, 337]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_021743__183.json0.0missing{\n "num_gpu": 99\n}missing
4559Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_123014__70600.032.92570[193, 589]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123014__706.json25.0missing{\n "num_gpu": 99\n}missing
4560Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_123045__78500.030.65550[193, 547]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123045__785.json50.0missing{\n "num_gpu": 99\n}missing
4561Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_021724__35200.036.50970[193, 490]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021724__352.json25.0missing{\n "num_gpu": 99\n}missing
4562Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_123508__17400.029.18170[372, 488]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_123508__174.json0.0missing{\n "num_gpu": 99\n}missing
4563Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_123539__94700.031.00880[372, 518]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_123539__947.json25.0missing{\n "num_gpu": 99\n}missing
4564Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_021926__50400.030.96670[372, 528]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021926__504.json0.0missing{\n "num_gpu": 99\n}missing
4565Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_123402__75900.029.66850[370, 505]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123402__759.json25.0missing{\n "num_gpu": 99\n}missing
4566Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_123438__75630.036.24934[370, 616]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123438__756.json90.0missing{\n "num_gpu": 99\n}missing
4567Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231227_021855__26200.041.64730[370, 717]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_021855__262.json25.0missing{\n "num_gpu": 99\n}missing
4568Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_124453__65400.069.68560[69, 414]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_124453__654.json25.0missing{\n "num_gpu": 99\n}missing
4569Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_124546__29000.052.64540[69, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_124546__290.json25.0missing{\n "num_gpu": 99\n}missing
4570Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_124702__36110.076.01054[69, 452]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_124702__361.json80.0missing{\n "num_gpu": 99\n}missing
4571Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_154522__74900.0104.3590[69, 617]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_154522__749.json50.0missing{\n "num_gpu": 99\n}missing
4572Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_154603__72800.040.10940[69, 233]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_154603__728.json25.0missing{\n "num_gpu": 99\n}missing
4573Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_124139__67720.062.41772[108, 364]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_124139__677.json72.5missing{\n "num_gpu": 99\n}missing
4574Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_124323__32100.0103.7640[108, 610]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_124323__321.json0.0missing{\n "num_gpu": 99\n}missing
4575Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_124343__71000.019.9450[108, 105]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_124343__710.json0.0missing{\n "num_gpu": 99\n}missing
4576Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_154212__81000.057.09330[108, 330]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_154212__810.json0.0missing{\n "num_gpu": 99\n}missing
4577Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_154337__46500.085.60780[108, 500]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_154337__465.json50.0missing{\n "num_gpu": 99\n}missing
4578Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_123845__73510.086.7481[197, 461]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123845__735.json61.25missing{\n "num_gpu": 99\n}missing
4579Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_123943__70110.056.31931[197, 311]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123943__701.json61.25missing{\n "num_gpu": 99\n}missing
4580Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_124037__84200.053.66940[197, 295]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_124037__842.json50.0missing{\n "num_gpu": 99\n}missing
4581Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_153945__79610.081.15451[197, 456]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_153945__796.json61.25missing{\n "num_gpu": 99\n}missing
4582Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_154114__22710.088.1791[197, 497]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_154114__227.json61.25missing{\n "num_gpu": 99\n}missing
4583Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_125408__28500.067.00150[382, 324]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125408__285.json50.0missing{\n "num_gpu": 99\n}missing
4584Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_125419__35800.010.6760[382, 5]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125419__358.json0.0missing{\n "num_gpu": 99\n}missing
4585Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_125614__56600.0114.8572[382, 587]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125614__566.json62.5missing{\n "num_gpu": 99\n}missing
4586Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_154818__63400.010.58080[382, 5]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_154818__634.json0.0missing{\n "num_gpu": 99\n}missing
4587Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_125118__28000.0106.00[380, 566]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_125118__280.json50.0missing{\n "num_gpu": 99\n}missing
4588Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_125301__20300.0102.4010[380, 522]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_125301__203.json50.0missing{\n "num_gpu": 99\n}missing
4589Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_154703__26000.060.80681[380, 304]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_154703__260.json56.25missing{\n "num_gpu": 99\n}missing
4590Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_154807__99500.063.51090[380, 320]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_154807__995.json0.0missing{\n "num_gpu": 99\n}missing
4591Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_140027__75100.014.78990[73, 373]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_140027__751.json50.0missing{\n "num_gpu": 99\n}missing
4592Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_140041__55500.013.64650[73, 343]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_140041__555.json50.0missing{\n "num_gpu": 99\n}missing
4593Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_021444__54900.016.4250[73, 412]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_021444__549.json50.0missing{\n "num_gpu": 99\n}missing
4594Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_135953__69100.022.01850[114, 549]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135953__691.json50.0missing{\n "num_gpu": 99\n}missing
4595Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_140012__16010.019.06622[114, 475]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_140012__160.json67.5missing{\n "num_gpu": 99\n}missing
4596Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_021427__57100.011.9420[114, 292]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_021427__571.json25.0missing{\n "num_gpu": 99\n}missing
4597Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_135913__29000.024.0360[202, 424]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135913__290.json25.0missing{\n "num_gpu": 99\n}missing
4598Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_135931__84800.017.86210[202, 428]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135931__848.json25.0missing{\n "num_gpu": 99\n}missing
4599Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_021415__57300.025.20610[202, 461]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021415__573.json25.0missing{\n "num_gpu": 99\n}missing
4600Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_140214__72400.016.71070[381, 371]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140214__724.json0.0missing{\n "num_gpu": 99\n}missing
4601Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_140239__17500.024.92710[381, 571]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140239__175.json25.0missing{\n "num_gpu": 99\n}missing
4602Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_021530__14100.022.71080[381, 515]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021530__141.json50.0missing{\n "num_gpu": 99\n}missing
4603Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_140137__27000.023.83170[379, 545]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_140137__270.json25.0missing{\n "num_gpu": 99\n}missing
4604Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_140157__20500.020.08220[379, 454]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_140157__205.json50.0missing{\n "num_gpu": 99\n}missing
4605Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_021507__78300.023.07780[379, 524]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_021507__783.json0.0missing{\n "num_gpu": 99\n}missing
4606Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231214_080705__43400.017.76450[70, 523]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_080705__434.json25.0missingmissingmissing
4607Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231225_122830__43100.09.952010[71, 322]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_122830__431.json25.0missing{\n "num_gpu": 99\n}missing
4608Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231225_122839__51900.09.125280[71, 294]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_122839__519.json25.0missing{\n "num_gpu": 99\n}missing
4609Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231227_013921__81200.014.51490[71, 468]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_013921__812.json25.0missing{\n "num_gpu": 99\n}missing
4610Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_080648__30200.013.73550[99, 398]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_080648__302.json50.0missingmissingmissing
4611Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_122810__42200.08.843152[112, 279]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_122810__422.json62.5missing{\n "num_gpu": 99\n}missing
4612Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231225_122820__16100.09.991830[112, 316]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_122820__161.json25.0missing{\n "num_gpu": 99\n}missing
4613Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_013906__63410.010.10382[112, 318]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_013906__634.json67.5missing{\n "num_gpu": 99\n}missing
4614Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_080634__52500.024.53010[187, 659]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080634__525.json25.0missingmissingmissing
4615Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_122749__68300.020.4690[200, 470]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122749__683.json50.0missing{\n "num_gpu": 99\n}missing
4616Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231225_122801__71600.011.35890[200, 344]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122801__716.json25.0missing{\n "num_gpu": 99\n}missing
4617Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231227_013856__30700.016.0510[200, 334]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013856__307.json25.0missing{\n "num_gpu": 99\n}missing
4618Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231214_080820__64000.029.2160[11, 767]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080820__640.json0.0missingmissingmissing
4619Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_123004__55400.018.6950[379, 540]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123004__554.json25.0missing{\n "num_gpu": 99\n}missing
4620Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_123021__57900.016.46390[379, 472]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123021__579.json50.0missing{\n "num_gpu": 99\n}missing
4621Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_013953__80200.011.59380[379, 318]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013953__802.json50.0missing{\n "num_gpu": 99\n}missing
4622Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231214_080750__53400.027.28550[370, 646]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_080750__534.json0.0missingmissingmissing
4623Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_122920__42500.018.24730[377, 527]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_122920__425.json50.0missing{\n "num_gpu": 99\n}missing
4624Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_122946__95400.025.39820[377, 742]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_122946__954.json50.0missing{\n "num_gpu": 99\n}missing
4625Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_013941__39300.020.55090[377, 593]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_013941__393.json50.0missing{\n "num_gpu": 99\n}missing
4626Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231214_082056__32200.013.80150[70, 410]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231214_082056__322.json0.0missingmissingmissing
4627Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231225_132003__53200.06.437520[73, 109]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231225_132003__532.json0.0missing{\n "num_gpu": 99\n}missing
4628Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231225_132021__66300.018.65270[73, 340]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231225_132021__663.json0.0missing{\n "num_gpu": 99\n}missing
4629Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231227_015854__34300.03.750150[73, 57]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231227_015854__343.json0.0missing{\n "num_gpu": 99\n}missing
4630Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_082042__15500.015.770[99, 454]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_082042__155.json50.0missingmissingmissing
4631Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_131940__53200.016.31540[112, 291]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_131940__532.json0.0missing{\n "num_gpu": 99\n}missing
4632Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_131956__50800.016.2030[112, 289]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_131956__508.json0.0missing{\n "num_gpu": 99\n}missing
4633Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_015850__36300.02.848480[112, 35]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_015850__363.json0.0missing{\n "num_gpu": 99\n}missing
4634Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231214_082026__38300.023.08930[187, 622]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082026__383.json25.0missingmissingmissing
4635Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_131856__75300.047.72540[200, 666]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131856__753.json0.0missing{\n "num_gpu": 99\n}missing
4636Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_131924__16500.027.29420[200, 472]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131924__165.json50.0missing{\n "num_gpu": 99\n}missing
4637Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231227_015847__16000.028.11880[200, 324]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_015847__160.json25.0missing{\n "num_gpu": 99\n}missing
4638Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231214_082230__14100.039.82190[11, 1011]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082230__141.json25.0missingmissingmissing
4639Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_132156__78700.015.93080[376, 236]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_132156__787.json0.0missing{\n "num_gpu": 99\n}missing
4640Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_132238__75300.042.34460[376, 693]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_132238__753.json0.0missing{\n "num_gpu": 99\n}missing
4641Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_015953__59900.05.013720[376, 36]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015953__599.json0.0missing{\n "num_gpu": 99\n}missing
4642Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTtruefalse520231214_082150__75100.041.6910[370, 984]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_082150__751.json25.0missingmissingmissing
4643Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_132054__87900.015.71770[373, 232]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_132054__879.json0.0missing{\n "num_gpu": 99\n}missing
4644Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTtruefalse520231225_132140__35900.045.86380[373, 752]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_132140__359.json25.0missing{\n "num_gpu": 99\n}missing
4645Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTtruefalse520231227_015948__41800.053.74840[373, 877]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_015948__418.json25.0missing{\n "num_gpu": 99\n}missing
4646Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_140421__89700.031.8240[63, 1160]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_140421__897.json0.0missing{\n "num_gpu": 99\n}missing
4647Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_140440__94400.018.9550[63, 722]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_140440__944.json0.0missing{\n "num_gpu": 99\n}missing
4648Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_021622__31200.036.93020[63, 1314]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_021622__312.json0.0missing{\n "num_gpu": 99\n}missing
4649Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_140318__38800.011.00230[100, 420]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_140318__388.json0.0missing{\n "num_gpu": 99\n}missing
4650Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_140349__47600.030.96990[100, 1119]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_140349__476.json0.0missing{\n "num_gpu": 99\n}missing
4651Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_021545__72200.010.37440[100, 394]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_021545__722.json0.0missing{\n "num_gpu": 99\n}missing
4652Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_140305__63600.025.92610[187, 812]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140305__636.json0.0missing{\n "num_gpu": 99\n}missing
4653Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_140307__98200.01.668780[187, 45]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140307__982.json0.0missing{\n "num_gpu": 99\n}missing
4654Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_021535__17100.04.905980[187, 36]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021535__171.json25.0missing{\n "num_gpu": 99\n}missing
4655Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_140607__57900.020.90120[352, 715]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140607__579.json0.0missing{\n "num_gpu": 99\n}missing
4656Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_140610__88300.03.172580[352, 80]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140610__883.json0.0missing{\n "num_gpu": 99\n}missing
4657Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_021648__30100.012.72650[352, 430]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021648__301.json0.0missing{\n "num_gpu": 99\n}missing
4658Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_140531__61900.028.90730[349, 978]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_140531__619.json0.0missing{\n "num_gpu": 99\n}missing
4659Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_140546__57600.015.38410[349, 527]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_140546__576.json0.0missing{\n "num_gpu": 99\n}missing
4660Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_021635__47600.013.02560[349, 441]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_021635__476.json0.0missing{\n "num_gpu": 99\n}missing
4661Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruefalse520231214_082317__45800.013.18890[70, 392]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_082317__458.json25.0missingmissingmissing
4662Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_132708__91730.062.73144[81, 492]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_132708__917.json90.0missing{\n "num_gpu": 99\n}missing
4663Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_132801__48810.052.73084[81, 413]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_132801__488.json80.0missing{\n "num_gpu": 99\n}missing
4664Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_020250__86510.045.02452[81, 345]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_020250__865.json67.5missing{\n "num_gpu": 99\n}missing
4665Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_082304__37000.014.67840[99, 423]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_082304__370.json0.0missingmissingmissing
4666Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_132510__44120.043.52232[120, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_132510__441.json72.5missing{\n "num_gpu": 99\n}missing
4667Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_132605__30120.054.71922[120, 422]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_132605__301.json72.5missing{\n "num_gpu": 99\n}missing
4668Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_020204__92730.054.74754[120, 417]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_020204__927.json90.0missing{\n "num_gpu": 99\n}missing
4669Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231214_082249__19600.019.26820[187, 518]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082249__196.json25.0missingmissingmissing
4670Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231225_132329__44700.050.74770[208, 197]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_132329__447.json25.0missing{\n "num_gpu": 99\n}missing
4671Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_132426__39120.057.26762[208, 424]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_132426__391.json72.5missing{\n "num_gpu": 99\n}missing
4672Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_020109__49430.076.34432[208, 409]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_020109__494.json77.5missing{\n "num_gpu": 99\n}missing
4673Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_082410__42100.09.466590[11, 264]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082410__421.json0.0missingmissingmissing
4674Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231225_133247__65400.053.5720[384, 361]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_133247__654.json25.0missing{\n "num_gpu": 99\n}missing
4675Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_133344__45220.057.56742[384, 392]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_133344__452.json72.5missing{\n "num_gpu": 99\n}missing
4676Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_020448__43620.057.87052[384, 391]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_020448__436.json72.5missing{\n "num_gpu": 99\n}missing
4677Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_082400__61800.024.66354[370, 581]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_082400__618.json75.0missingmissingmissing
4678Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231225_133034__78000.061.70810[381, 424]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_133034__780.json25.0missing{\n "num_gpu": 99\n}missing
4679Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231225_133153__83600.078.8330[381, 555]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_133153__836.json25.0missing{\n "num_gpu": 99\n}missing
4680Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_020350__47410.059.98141[381, 408]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_020350__474.json61.25missing{\n "num_gpu": 99\n}missing
4681Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_135056__60500.024.47310[73, 416]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_135056__605.json50.0missing{\n "num_gpu": 99\n}missing
4682Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_135124__41710.027.55131[73, 469]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_135124__417.json61.25missing{\n "num_gpu": 99\n}missing
4683Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231227_021130__28300.028.06320[73, 476]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_021130__283.json25.0missing{\n "num_gpu": 99\n}missing
4684Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_135002__44200.013.85680[114, 227]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135002__442.json0.0missing{\n "num_gpu": 99\n}missing
4685Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_135032__60000.029.4790[114, 495]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135032__600.json25.0missing{\n "num_gpu": 99\n}missing
4686Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_021102__81000.029.52960[114, 494]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_021102__810.json25.0missing{\n "num_gpu": 99\n}missing
4687Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_134926__61600.036.93620[202, 453]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_134926__616.json25.0missing{\n "num_gpu": 99\n}missing
4688Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_134949__99500.022.47640[202, 360]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_134949__995.json0.0missing{\n "num_gpu": 99\n}missing
4689Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_021033__63900.027.36270[202, 293]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021033__639.json25.0missing{\n "num_gpu": 99\n}missing
4690Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_135331__16200.024.94660[381, 373]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135331__162.json50.0missing{\n "num_gpu": 99\n}missing
4691Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_135413__35000.041.37850[381, 641]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135413__350.json25.0missing{\n "num_gpu": 99\n}missing
4692Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_021222__28600.022.840[381, 337]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021222__286.json0.0missing{\n "num_gpu": 99\n}missing
4693Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_135244__15900.023.95560[379, 357]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135244__159.json25.0missing{\n "num_gpu": 99\n}missing
4694Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_135306__56800.021.72730[379, 320]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135306__568.json50.0missing{\n "num_gpu": 99\n}missing
4695Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_021159__62600.028.71770[379, 434]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_021159__626.json25.0missing{\n "num_gpu": 99\n}missing
4696Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTtruefalse520231214_081858__61700.014.83520[70, 441]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_081858__617.json25.0missingmissingmissing
4697Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTfalsefalse520231225_131644__85600.07.917790[75, 450]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_131644__856.json0.0missing{\n "num_gpu": 99\n}missing
4698Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTtruefalse520231225_131654__76600.09.144370[75, 516]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_131654__766.json25.0missing{\n "num_gpu": 99\n}missing
4699Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTtruefalse520231227_015800__39800.010.33430[75, 573]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_015800__398.json25.0missing{\n "num_gpu": 99\n}missing
4700Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_081843__45800.012.55480[99, 362]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_081843__458.json0.0missingmissingmissing
4701Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_131627__10000.08.097510[112, 451]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_131627__100.json0.0missing{\n "num_gpu": 99\n}missing
4702Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_131637__19800.09.436570[112, 523]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_131637__198.json0.0missing{\n "num_gpu": 99\n}missing
4703Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_015750__70200.010.47330[112, 570]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_015750__702.json0.0missing{\n "num_gpu": 99\n}missing
4704Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_081830__58600.024.72670[187, 663]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081830__586.json50.0missingmissingmissing
4705Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_131612__43100.018.17420[196, 788]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131612__431.json0.0missing{\n "num_gpu": 99\n}missing
4706Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_131619__54200.07.375890[196, 389]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131619__542.json0.0missing{\n "num_gpu": 99\n}missing
4707Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_015739__32700.012.58230[196, 515]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_015739__327.json0.0missing{\n "num_gpu": 99\n}missing
4708Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231214_082003__71500.025.91450[11, 688]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082003__715.json50.0missingmissingmissing
4709Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_131751__85100.013.94180[362, 666]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131751__851.json0.0missing{\n "num_gpu": 99\n}missing
4710Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_131809__40300.017.88490[362, 847]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131809__403.json0.0missing{\n "num_gpu": 99\n}missing
4711Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_015819__82500.012.01210[362, 568]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015819__825.json0.0missing{\n "num_gpu": 99\n}missing
4712Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231214_081937__24000.025.57110[370, 603]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_081937__240.json0.0missingmissingmissing
4713Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_131728__33300.010.34480[360, 492]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_131728__333.json0.0missing{\n "num_gpu": 99\n}missing
4714Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_131737__61600.08.998950[360, 427]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_131737__616.json0.0missing{\n "num_gpu": 99\n}missing
4715Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTtruefalse520231227_015807__39000.07.262550[360, 334]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_015807__390.json25.0missing{\n "num_gpu": 99\n}missing
4716Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruefalse520231214_080904__50400.012.11930[70, 361]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_080904__504.json25.0missingmissingmissing
4717Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruetrue520231225_123132__73700.015.63970[73, 507]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_123132__737.json50.0missing{\n "num_gpu": 99\n}missing
4718Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruefalse520231225_123142__92400.09.737970[73, 314]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_123142__924.json25.0missing{\n "num_gpu": 99\n}missing
4719Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruetrue520231227_014042__40100.012.15240[73, 391]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_014042__401.json50.0missing{\n "num_gpu": 99\n}missing
4720Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231214_080852__74800.010.8070[99, 312]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_080852__748.json25.0missingmissingmissing
4721Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231225_123104__81700.014.2840[114, 455]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_123104__817.json25.0missing{\n "num_gpu": 99\n}missing
4722Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_123116__38300.012.47570[114, 397]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_123116__383.json50.0missing{\n "num_gpu": 99\n}missing
4723Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_014029__24600.017.3990[114, 551]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_014029__246.json50.0missing{\n "num_gpu": 99\n}missing
4724Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_080841__52200.021.34630[187, 576]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080841__522.json0.0missingmissingmissing
4725Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_123037__15600.016.36470[202, 333]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123037__156.json50.0missing{\n "num_gpu": 99\n}missing
4726Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231225_123049__82900.011.84290[202, 357]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123049__829.json0.0missing{\n "num_gpu": 99\n}missing
4727Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_014012__89710.018.81811[202, 415]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_014012__897.json61.25missing{\n "num_gpu": 99\n}missing
4728Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_081006__47400.015.46940[11, 425]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081006__474.json0.0missingmissingmissing
4729Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_123241__94810.011.16971[381, 306]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123241__948.json61.25missing{\n "num_gpu": 99\n}missing
4730Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231225_123253__23700.012.29550[381, 342]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123253__237.json0.0missing{\n "num_gpu": 99\n}missing
4731Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_014116__93600.022.0621[381, 637]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_014116__936.json56.25missing{\n "num_gpu": 99\n}missing
4732Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_080950__59000.022.88690[370, 536]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_080950__590.json50.0missingmissingmissing
4733Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_123215__46100.012.8571[379, 359]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_123215__461.json56.25missing{\n "num_gpu": 99\n}missing
4734Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_123229__16410.014.18041[379, 401]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_123229__164.json61.25missing{\n "num_gpu": 99\n}missing
4735Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_014054__28800.012.6410[379, 350]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_014054__288.json50.0missing{\n "num_gpu": 99\n}missing
4736Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruefalse520231214_081055__76300.017.83150[70, 524]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_081055__763.json25.0missingmissingmissing
4737Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruefalse520231225_123848__32000.0109.4080[69, 822]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_123848__320.json25.0missing{\n "num_gpu": 99\n}missing
4738Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruefalse520231225_124103__60500.0134.5810[69, 1002]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_124103__605.json25.0missing{\n "num_gpu": 99\n}missing
4739Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruetrue520231227_014510__40800.070.84130[69, 533]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_014510__408.json50.0missing{\n "num_gpu": 99\n}missing
4740Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231214_081037__41500.013.62360[99, 394]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_081037__415.json25.0missingmissingmissing
4741Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_123608__45500.033.21810[108, 242]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_123608__455.json50.0missing{\n "num_gpu": 99\n}missing
4742Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_123659__81300.050.14180[108, 372]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_123659__813.json25.0missing{\n "num_gpu": 99\n}missing
4743Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231227_014359__33700.062.84980[108, 467]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_014359__337.json25.0missing{\n "num_gpu": 99\n}missing
4744Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_081023__30600.017.13990[187, 463]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081023__306.json50.0missingmissingmissing
4745Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231225_123442__69400.0109.1790[197, 621]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123442__694.json0.0missing{\n "num_gpu": 99\n}missing
4746Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_123535__40810.052.61721[197, 373]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123535__408.json61.25missing{\n "num_gpu": 99\n}missing
4747Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231227_014255__45500.097.7883[197, 539]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_014255__455.json68.75missing{\n "num_gpu": 99\n}missing
4748Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_081158__37100.016.01210[11, 440]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081158__371.json0.0missingmissingmissing
4749Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231225_124650__77000.010.03210[382, 17]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_124650__770.json0.0missing{\n "num_gpu": 99\n}missing
4750Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_124813__51900.082.49020[382, 558]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_124813__519.json25.0missing{\n "num_gpu": 99\n}missing
4751Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231227_014714__68600.084.03580[382, 567]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_014714__686.json25.0missing{\n "num_gpu": 99\n}missing
4752Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_081142__96100.026.26990[370, 621]0.4.041.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_081142__961.json50.0missingmissingmissing
4753Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTfalsefalse520231225_124553__42800.096.17830[380, 657]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_124553__428.json0.0missing{\n "num_gpu": 99\n}missing
4754Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_124640__28910.047.09371[380, 299]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_124640__289.json61.25missing{\n "num_gpu": 99\n}missing
4755Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTtruefalse520231227_014550__61800.040.29050[380, 247]0.6.041.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_014550__618.json25.0missing{\n "num_gpu": 99\n}missing
4756Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231214_083245__59000.010.16771[99, 294]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_083245__590.json58.3333missingmissingmissing
4757Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231225_095852__55900.018.93752[107, 341]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_095852__559.json66.6667missing{\n "num_gpu": 99\n}missing
4758Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231225_095918__25300.026.01040[107, 470]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_095918__253.json50.0missing{\n "num_gpu": 99\n}missing
4759Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231227_023107__73000.018.30672[107, 327]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_023107__730.json66.6667missing{\n "num_gpu": 99\n}missing
4760Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruefalse520231227_081626__77500.08.662740[107, 147]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_081626__775.json25.0missing{\n "num_gpu": 99\n}missing
4761Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_083235__26700.02.743520[128, 60]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_083235__267.json50.0missingmissingmissing
4762Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_095825__93400.016.80321[145, 294]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_095825__934.json58.3333missing{\n "num_gpu": 99\n}missing
4763Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_095833__64300.07.495582[145, 119]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_095833__643.json66.6667missing{\n "num_gpu": 99\n}missing
4764Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_023048__36000.022.59642[145, 400]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_023048__360.json66.6667missing{\n "num_gpu": 99\n}missing
4765Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_081617__67500.012.85092[145, 220]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_081617__675.json66.6667missing{\n "num_gpu": 99\n}missing
4766Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231214_083232__94500.019.08770[229, 496]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083232__945.json50.0missingmissingmissing
4767Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_095751__74100.029.93713[247, 334]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_095751__741.json75.0missing{\n "num_gpu": 99\n}missing
4768Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_095808__67400.015.95870[247, 256]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_095808__674.json50.0missing{\n "num_gpu": 99\n}missing
4769Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_023026__47800.030.19532[247, 349]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_023026__478.json66.6667missing{\n "num_gpu": 99\n}missing
4770Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_081604__19400.023.17590[247, 220]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081604__194.json50.0missing{\n "num_gpu": 99\n}missing
4771Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_083351__57600.030.8240[11, 799]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083351__576.json50.0missingmissingmissing
4772Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_100053__33900.028.11591[410, 440]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100053__339.json58.3333missing{\n "num_gpu": 99\n}missing
4773Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_100126__55600.032.62410[410, 514]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100126__556.json50.0missing{\n "num_gpu": 99\n}missing
4774Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_023206__78620.021.97961[410, 337]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_023206__786.json68.3333missing{\n "num_gpu": 99\n}missing
4775Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_081713__67500.021.9731[410, 337]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_081713__675.json58.3333missing{\n "num_gpu": 99\n}missing
4776Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_083320__38500.019.2280[399, 428]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_083320__385.json0.0missingmissingmissing
4777Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231225_100008__83700.017.44320[407, 257]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_100008__837.json0.0missing{\n "num_gpu": 99\n}missing
4778Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_100024__59200.016.78711[407, 240]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_100024__592.json58.3333missing{\n "num_gpu": 99\n}missing
4779Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_023144__50400.037.00132[407, 595]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_023144__504.json66.6667missing{\n "num_gpu": 99\n}missing
4780Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_081651__91400.025.20540[407, 393]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_081651__914.json50.0missing{\n "num_gpu": 99\n}missing
4781Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonInJulia1SHOTtruefalse520231214_083430__76600.014.29940[99, 414]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_083430__766.json25.0missingmissingmissing
4782Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonInJulia1SHOTtruefalse520231225_100223__56800.07.440020[81, 125]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_100223__568.json25.0missing{\n "num_gpu": 99\n}missing
4783Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonInJulia1SHOTfalsefalse520231225_100230__43400.07.480110[81, 127]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_100230__434.json0.0missing{\n "num_gpu": 99\n}missing
4784Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231214_083415__76800.010.6190[128, 301]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_083415__768.json50.0missingmissingmissing
4785Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_100204__44200.021.15190[82, 381]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_100204__442.json0.0missing{\n "num_gpu": 99\n}missing
4786Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_100215__92300.011.03150[82, 192]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_100215__923.json0.0missing{\n "num_gpu": 99\n}missing
4787Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_083405__32000.014.14341[229, 362]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083405__320.json58.3333missingmissingmissing
4788Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_100141__73500.015.38050[122, 84]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100141__735.json0.0missing{\n "num_gpu": 99\n}missing
4789Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_100143__98300.02.09630[122, 20]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100143__983.json0.0missing{\n "num_gpu": 99\n}missing
4790Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231214_083533__72500.017.20720[11, 466]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083533__725.json25.0missingmissingmissing
4791Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_100347__87400.015.57410[99, 273]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100347__874.json0.0missing{\n "num_gpu": 99\n}missing
4792Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_100351__26100.04.275120[99, 62]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100351__261.json0.0missing{\n "num_gpu": 99\n}missing
4793Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_083515__39400.028.28690[399, 655]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_083515__394.json0.0missingmissingmissing
4794Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_100315__73600.07.344250[96, 123]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_100315__736.json0.0missing{\n "num_gpu": 99\n}missing
4795Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_100331__55400.016.2360[96, 288]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_100331__554.json25.0missing{\n "num_gpu": 99\n}missing
4796Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_111843__90600.048.71370[107, 283]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_111843__906.json0.0missing{\n "num_gpu": 99\n}missing
4797Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_082923__51300.063.5642[107, 380]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_082923__513.json66.6667missing{\n "num_gpu": 99\n}missing
4798Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_102435__20000.050.67830[148, 295]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_102435__200.json0.0missing{\n "num_gpu": 99\n}missing
4799Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_102514__11900.039.70930[148, 227]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_102514__119.json0.0missing{\n "num_gpu": 99\n}missing
4800Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_082819__57300.044.69340[148, 257]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_082819__573.json0.0missing{\n "num_gpu": 99\n}missing
4801Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_102257__56700.077.13850[250, 277]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_102257__567.json0.0missing{\n "num_gpu": 99\n}missing
4802Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_102344__80000.047.11440[250, 256]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_102344__800.json0.0missing{\n "num_gpu": 99\n}missing
4803Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_082734__75000.091.89280[250, 377]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_082734__750.json0.0missing{\n "num_gpu": 99\n}missing
4804Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_112409__14300.072.65610[436, 375]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_112409__143.json0.0missing{\n "num_gpu": 99\n}missing
4805Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_112536__49500.086.51730[436, 458]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_112536__495.json0.0missing{\n "num_gpu": 99\n}missing
4806Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_083159__49230.076.51463[436, 398]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083159__492.json90.0missing{\n "num_gpu": 99\n}missing
4807Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_112130__29200.050.56653[434, 235]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112130__292.json75.0missing{\n "num_gpu": 99\n}missing
4808Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_112256__88900.085.51610[434, 442]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112256__889.json0.0missing{\n "num_gpu": 99\n}missing
4809Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_083042__18200.078.91850[434, 412]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083042__182.json0.0missing{\n "num_gpu": 99\n}missing
4810Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_084044__25800.010.17250[102, 386]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_084044__258.json0.0missing{\n "num_gpu": 99\n}missing
4811Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_125708__39400.09.269250[102, 345]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_125708__394.json25.0missing{\n "num_gpu": 99\n}missing
4812Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_125728__27800.020.35210[102, 745]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_125728__278.json0.0missing{\n "num_gpu": 99\n}missing
4813Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_125739__65400.010.65760[102, 404]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_125739__654.json0.0missing{\n "num_gpu": 99\n}missing
4814Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_084033__41000.05.950060[139, 219]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_084033__410.json50.0missing{\n "num_gpu": 99\n}missing
4815Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_125635__41900.03.496610[139, 119]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_125635__419.json0.0missing{\n "num_gpu": 99\n}missing
4816Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_125641__18900.06.558090[139, 232]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_125641__189.json0.0missing{\n "num_gpu": 99\n}missing
4817Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_125659__58100.017.27920[139, 616]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_125659__581.json0.0missing{\n "num_gpu": 99\n}missing
4818Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_084028__55500.011.48240[238, 282]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084028__555.json25.0missing{\n "num_gpu": 99\n}missing
4819Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_125623__89900.08.23740[238, 150]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_125623__899.json0.0missing{\n "num_gpu": 99\n}missing
4820Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_125627__17200.04.308910[238, 136]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_125627__172.json0.0missing{\n "num_gpu": 99\n}missing
4821Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_125631__18700.04.141380[238, 129]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_125631__187.json0.0missing{\n "num_gpu": 99\n}missing
4822Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_084057__71900.06.968470[391, 212]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084057__719.json0.0missing{\n "num_gpu": 99\n}missing
4823Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_125815__59200.09.324380[391, 297]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125815__592.json0.0missing{\n "num_gpu": 99\n}missing
4824Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_125827__86200.011.3810[391, 366]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125827__862.json0.0missing{\n "num_gpu": 99\n}missing
4825Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_125836__67200.09.783390[391, 313]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125836__672.json0.0missing{\n "num_gpu": 99\n}missing
4826Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_084050__44900.05.990480[388, 176]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_084050__449.json0.0missing{\n "num_gpu": 99\n}missing
4827Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_125748__86000.08.842510[388, 280]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_125748__860.json50.0missing{\n "num_gpu": 99\n}missing
4828Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_125757__64500.09.461610[388, 302]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_125757__645.json50.0missing{\n "num_gpu": 99\n}missing
4829Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_125806__58200.08.469730[388, 266]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_125806__582.json0.0missing{\n "num_gpu": 99\n}missing
4830Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruefalse520231214_082500__22500.014.1940[99, 411]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231214_082500__225.json25.0missingmissingmissing
4831Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruefalse520231225_093736__27400.028.7210[99, 806]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231225_093736__274.json25.0missing{\n "num_gpu": 99\n}missing
4832Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231225_093755__70200.019.3520[1, 578]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231225_093755__702.json50.0missing{\n "num_gpu": 99\n}missing
4833Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231227_022112__80000.010.02060[99, 295]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231227_022112__800.json50.0missing{\n "num_gpu": 99\n}missing
4834Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruefalse520231227_080554__50400.021.28070[99, 614]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231227_080554__504.json25.0missing{\n "num_gpu": 99\n}missing
4835Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruefalse520231214_082446__58700.015.49850[128, 440]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_082446__587.json25.0missingmissingmissing
4836Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruetrue520231225_093658__70700.06.292490[128, 173]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_093658__707.json50.0missing{\n "num_gpu": 99\n}missing
4837Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruetrue520231225_093707__36700.08.542170[1, 266]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_093707__367.json50.0missing{\n "num_gpu": 99\n}missing
4838Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruefalse520231227_022102__52200.011.28930[128, 326]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_022102__522.json25.0missing{\n "num_gpu": 99\n}missing
4839Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruetrue520231227_080531__30800.010.11580[128, 287]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_080531__308.json50.0missing{\n "num_gpu": 99\n}missing
4840Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruetrue520231214_082431__59600.020.62580[229, 537]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082431__596.json50.0missingmissingmissing
4841Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruetrue520231225_093640__41300.021.94712[247, 436]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093640__413.json66.6667missing{\n "num_gpu": 99\n}missing
4842Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruetrue520231225_093652__23300.012.07590[1, 356]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093652__233.json50.0missing{\n "num_gpu": 99\n}missing
4843Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruefalse520231227_022051__50600.023.16670[247, 485]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022051__506.json25.0missing{\n "num_gpu": 99\n}missing
4844Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruefalse520231227_080521__22000.023.1070[247, 373]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_080521__220.json25.0missing{\n "num_gpu": 99\n}missing
4845Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTfalsefalse520231214_082600__49300.019.50820[11, 525]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082600__493.json0.0missingmissingmissing
4846Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTtruefalse520231225_093930__73700.021.69140[11, 582]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093930__737.json25.0missing{\n "num_gpu": 99\n}missing
4847Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTtruetrue520231225_093951__41400.020.47820[1, 557]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093951__414.json50.0missing{\n "num_gpu": 99\n}missing
4848Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTtruetrue520231227_022215__44300.024.55590[11, 659]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022215__443.json50.0missing{\n "num_gpu": 99\n}missing
4849Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTfalsefalse520231227_080621__39400.04.804780[11, 135]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_080621__394.json0.0missing{\n "num_gpu": 99\n}missing
4850Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruetrue520231214_082541__57500.023.02490[399, 525]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_082541__575.json50.0missingmissingmissing
4851Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruetrue520231225_093846__99200.019.99810[399, 450]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_093846__992.json50.0missing{\n "num_gpu": 99\n}missing
4852Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruetrue520231225_093908__41900.022.7660[1, 613]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_093908__419.json50.0missing{\n "num_gpu": 99\n}missing
4853Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruefalse520231227_022150__81600.037.83670[399, 892]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_022150__816.json25.0missing{\n "num_gpu": 99\n}missing
4854Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTfalsefalse520231227_080616__57600.021.84560[399, 502]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_080616__576.json0.0missing{\n "num_gpu": 99\n}missing
4855Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruefalse520231214_083623__72900.020.6080[99, 590]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231214_083623__729.json25.0missingmissingmissing
4856Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231225_100452__82000.09.600362[99, 309]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231225_100452__820.json66.6667missing{\n "num_gpu": 99\n}missing
4857Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231225_100500__13600.08.274451[99, 265]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231225_100500__136.json58.3333missing{\n "num_gpu": 99\n}missing
4858Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231227_023242__22700.010.66371[99, 343]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231227_023242__227.json58.3333missing{\n "num_gpu": 99\n}missing
4859Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231227_081747__47910.07.572622[99, 240]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231227_081747__479.json71.6667missing{\n "num_gpu": 99\n}missing
4860Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTtruetrue520231214_083602__36100.02.722570[128, 59]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_083602__361.json50.0missingmissingmissing
4861Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTtruetrue520231225_100427__37100.012.17470[138, 384]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_100427__371.json50.0missing{\n "num_gpu": 99\n}missing
4862Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTfalsefalse520231225_100442__92500.014.37770[138, 454]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_100442__925.json0.0missing{\n "num_gpu": 99\n}missing
4863Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTtruetrue520231227_023231__14600.09.882322[138, 312]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_023231__146.json66.6667missing{\n "num_gpu": 99\n}missing
4864Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTfalsefalse520231227_081740__36900.07.641610[138, 236]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_081740__369.json0.0missing{\n "num_gpu": 99\n}missing
4865Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTtruetrue520231214_083559__84600.026.55450[229, 690]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083559__846.json50.0missingmissingmissing
4866Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_100406__54500.014.9670[239, 255]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100406__545.json0.0missing{\n "num_gpu": 99\n}missing
4867Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_100415__86400.08.991972[239, 262]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100415__864.json66.6667missing{\n "num_gpu": 99\n}missing
4868Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTfalsefalse520231227_023221__80300.014.82560[239, 267]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_023221__803.json0.0missing{\n "num_gpu": 99\n}missing
4869Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTfalsefalse520231227_081732__29200.018.9850[239, 400]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081732__292.json0.0missing{\n "num_gpu": 99\n}missing
4870Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_083734__72900.029.43080[11, 767]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083734__729.json50.0missingmissingmissing
4871Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_100552__86210.014.18442[402, 398]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100552__862.json71.6667missing{\n "num_gpu": 99\n}missing
4872Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_100602__77000.09.706112[402, 259]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100602__770.json66.6667missing{\n "num_gpu": 99\n}missing
4873Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_081808__49900.08.517220[402, 217]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_081808__499.json50.0missing{\n "num_gpu": 99\n}missing
4874Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTtruetrue520231214_083704__95800.023.77420[399, 544]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_083704__958.json50.0missingmissingmissing
4875Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTtruetrue520231225_100528__66900.09.916062[399, 265]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_100528__669.json66.6667missing{\n "num_gpu": 99\n}missing
4876Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTtruetrue520231225_100538__65500.09.262513[399, 245]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_100538__655.json75.0missing{\n "num_gpu": 99\n}missing
4877Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTfalsefalse520231227_081800__86900.012.5790[399, 344]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_081800__869.json0.0missing{\n "num_gpu": 99\n}missing
4878Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_182630__96800.020.11250[99, 373]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182630__968.json50.0missing{\n "num_gpu": 99\n}missing
4879Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_182647__64810.016.7943[99, 321]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182647__648.json80.0missing{\n "num_gpu": 99\n}missing
4880Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_182705__82000.017.81970[99, 341]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182705__820.json50.0missing{\n "num_gpu": 99\n}missing
4881Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182534__86110.019.70713[138, 368]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182534__861.json80.0missing{\n "num_gpu": 99\n}missing
4882Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182550__30000.015.89220[138, 295]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182550__300.json50.0missing{\n "num_gpu": 99\n}missing
4883Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182610__86410.019.63122[138, 366]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182610__864.json71.6667missing{\n "num_gpu": 99\n}missing
4884Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_182441__30800.019.50050[239, 356]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182441__308.json0.0missing{\n "num_gpu": 99\n}missing
4885Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_182458__43600.017.09080[239, 302]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182458__436.json0.0missing{\n "num_gpu": 99\n}missing
4886Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182515__99230.016.89143[239, 302]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182515__992.json90.0missing{\n "num_gpu": 99\n}missing
4887Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182825__19510.030.7652[402, 525]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182825__195.json71.6667missing{\n "num_gpu": 99\n}missing
4888Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182844__65700.019.2243[402, 328]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182844__657.json75.0missing{\n "num_gpu": 99\n}missing
4889Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182913__57510.028.42362[402, 501]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182913__575.json71.6667missing{\n "num_gpu": 99\n}missing
4890Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182717__99700.011.99210[399, 191]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182717__997.json50.0missing{\n "num_gpu": 99\n}missing
4891Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182735__94930.017.37962[399, 294]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182735__949.json81.6667missing{\n "num_gpu": 99\n}missing
4892Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182754__58000.019.20660[399, 328]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182754__580.json50.0missing{\n "num_gpu": 99\n}missing
4893Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_113118__58000.011.2290[99, 277]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_113118__580.json50.0missing{\n "num_gpu": 99\n}missing
4894Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_113125__85300.07.464620[99, 179]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_113125__853.json0.0missing{\n "num_gpu": 99\n}missing
4895Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_083442__53700.011.29861[99, 277]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_083442__537.json58.3333missing{\n "num_gpu": 99\n}missing
4896Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_113057__87200.06.261220[140, 143]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113057__872.json0.0missing{\n "num_gpu": 99\n}missing
4897Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_113106__81300.09.714460[140, 232]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113106__813.json50.0missing{\n "num_gpu": 99\n}missing
4898Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_083431__27000.07.608790[140, 177]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_083431__270.json0.0missing{\n "num_gpu": 99\n}missing
4899Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_113035__16000.023.90991[241, 435]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113035__160.json58.3333missing{\n "num_gpu": 99\n}missing
4900Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_113050__20700.014.88130[241, 348]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113050__207.json0.0missing{\n "num_gpu": 99\n}missing
4901Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_083423__11800.016.68180[241, 257]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083423__118.json25.0missing{\n "num_gpu": 99\n}missing
4902Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_113218__49300.09.436580[407, 185]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113218__493.json0.0missing{\n "num_gpu": 99\n}missing
4903Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113235__28600.017.57260[407, 388]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113235__286.json50.0missing{\n "num_gpu": 99\n}missing
4904Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_083506__27800.08.580930[407, 163]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083506__278.json0.0missing{\n "num_gpu": 99\n}missing
4905Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_113149__36700.011.45880[405, 236]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113149__367.json50.0missing{\n "num_gpu": 99\n}missing
4906Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_113208__11200.019.35890[405, 432]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113208__112.json0.0missing{\n "num_gpu": 99\n}missing
4907Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_083457__62900.014.7730[405, 317]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083457__629.json50.0missing{\n "num_gpu": 99\n}missing
4908Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002741__82700.017.19140[98, 538]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002741__827.json50.0missing{\n "num_gpu": 99\n}missing
4909Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002758__19200.016.46420[98, 515]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002758__192.json50.0missing{\n "num_gpu": 99\n}missing
4910Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002811__71300.012.85353[98, 400]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002811__713.json75.0missing{\n "num_gpu": 99\n}missing
4911Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_002829__92800.018.13380[98, 567]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002829__928.json0.0missing{\n "num_gpu": 99\n}missing
4912Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002851__62400.021.62340[98, 675]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002851__624.json50.0missing{\n "num_gpu": 99\n}missing
4913Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_002644__58500.06.81263[139, 200]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002644__585.json75.0missing{\n "num_gpu": 99\n}missing
4914Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_002653__49200.08.47742[139, 255]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002653__492.json66.6667missing{\n "num_gpu": 99\n}missing
4915Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_002703__11100.010.6410[139, 324]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002703__111.json0.0missing{\n "num_gpu": 99\n}missing
4916Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_002715__35200.011.15553[139, 341]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002715__352.json75.0missing{\n "num_gpu": 99\n}missing
4917Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_002724__21400.09.273230[139, 280]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002724__214.json0.0missing{\n "num_gpu": 99\n}missing
4918Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_002528__71900.016.89280[240, 476]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002528__719.json25.0missing{\n "num_gpu": 99\n}missing
4919Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_002546__69200.017.83620[240, 530]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002546__692.json25.0missing{\n "num_gpu": 99\n}missing
4920Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_002600__21300.013.25340[240, 389]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002600__213.json50.0missing{\n "num_gpu": 99\n}missing
4921Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_002614__85900.014.21130[240, 418]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002614__859.json50.0missing{\n "num_gpu": 99\n}missing
4922Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_002637__76300.022.84150[240, 681]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002637__763.json0.0missing{\n "num_gpu": 99\n}missing
4923Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003106__96300.019.55051[406, 547]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003106__963.json58.3333missing{\n "num_gpu": 99\n}missing
4924Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003125__33500.018.39740[406, 512]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003125__335.json50.0missing{\n "num_gpu": 99\n}missing
4925Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_003148__40700.022.82960[406, 644]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003148__407.json25.0missing{\n "num_gpu": 99\n}missing
4926Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003204__58200.016.7893[406, 465]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003204__582.json75.0missing{\n "num_gpu": 99\n}missing
4927Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003232__96900.027.00760[406, 765]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003232__969.json50.0missing{\n "num_gpu": 99\n}missing
4928Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_002914__32000.022.48061[404, 634]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_002914__320.json58.3333missing{\n "num_gpu": 99\n}missing
4929Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_002946__25600.031.79540[404, 900]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_002946__256.json50.0missing{\n "num_gpu": 99\n}missing
4930Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231228_003006__58200.019.79440[404, 554]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_003006__582.json0.0missing{\n "num_gpu": 99\n}missing
4931Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231228_003032__84900.026.56270[404, 752]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_003032__849.json25.0missing{\n "num_gpu": 99\n}missing
4932Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_003046__30200.014.02320[404, 381]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_003046__302.json50.0missing{\n "num_gpu": 99\n}missing
4933Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_003545__71800.016.46360[98, 407]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003545__718.json50.0missing{\n "num_gpu": 99\n}missing
4934Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_003604__68900.018.9360[98, 469]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003604__689.json0.0missing{\n "num_gpu": 99\n}missing
4935Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_003630__10700.025.47260[98, 631]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003630__107.json0.0missing{\n "num_gpu": 99\n}missing
4936Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_003651__69000.021.2190[98, 526]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003651__690.json50.0missing{\n "num_gpu": 99\n}missing
4937Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_003708__48800.016.61650[98, 411]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003708__488.json50.0missing{\n "num_gpu": 99\n}missing
4938Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_003422__17000.012.13970[139, 292]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003422__170.json50.0missing{\n "num_gpu": 99\n}missing
4939Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231228_003446__36300.023.54760[139, 577]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003446__363.json0.0missing{\n "num_gpu": 99\n}missing
4940Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_003506__39600.020.45883[139, 501]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003506__396.json75.0missing{\n "num_gpu": 99\n}missing
4941Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_003518__24000.011.41060[139, 273]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003518__240.json50.0missing{\n "num_gpu": 99\n}missing
4942Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231228_003529__98800.010.41520[139, 248]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003529__988.json0.0missing{\n "num_gpu": 99\n}missing
4943Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_003252__14300.020.11840[240, 454]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003252__143.json25.0missing{\n "num_gpu": 99\n}missing
4944Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_003308__34900.016.20482[240, 378]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003308__349.json66.6667missing{\n "num_gpu": 99\n}missing
4945Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_003330__98400.021.11890[240, 499]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003330__984.json0.0missing{\n "num_gpu": 99\n}missing
4946Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_003354__41000.024.01770[240, 570]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003354__410.json50.0missing{\n "num_gpu": 99\n}missing
4947Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_003410__73600.015.88980[240, 370]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003410__736.json25.0missing{\n "num_gpu": 99\n}missing
4948Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_003943__14600.034.78830[406, 792]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003943__146.json25.0missing{\n "num_gpu": 99\n}missing
4949Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_003958__51800.015.60940[406, 336]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003958__518.json50.0missing{\n "num_gpu": 99\n}missing
4950Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_004041__88200.042.15350[406, 960]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004041__882.json50.0missing{\n "num_gpu": 99\n}missing
4951Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_004100__36700.019.15910[406, 422]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004100__367.json50.0missing{\n "num_gpu": 99\n}missing
4952Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_004119__23500.018.66710[406, 410]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004119__235.json50.0missing{\n "num_gpu": 99\n}missing
4953Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_003727__94100.018.66750[404, 410]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003727__941.json0.0missing{\n "num_gpu": 99\n}missing
4954Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_003758__40000.031.29240[404, 711]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003758__400.json50.0missing{\n "num_gpu": 99\n}missing
4955Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_003818__11600.020.58670[404, 457]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003818__116.json0.0missing{\n "num_gpu": 99\n}missing
4956Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_003836__15000.017.45451[404, 381]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003836__150.json58.3333missing{\n "num_gpu": 99\n}missing
4957Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_003908__12300.031.80390[404, 723]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003908__123.json25.0missing{\n "num_gpu": 99\n}missing
4958Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_123720__31200.020.69020[98, 370]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123720__312.json25.0missing{\n "num_gpu": 99\n}missing
4959Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_123811__47900.050.65220[98, 904]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123811__479.json0.0missing{\n "num_gpu": 99\n}missing
4960Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231227_083854__93600.030.22740[98, 552]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_083854__936.json0.0missing{\n "num_gpu": 99\n}missing
4961Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_123643__21300.016.45890[139, 293]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123643__213.json50.0missing{\n "num_gpu": 99\n}missing
4962Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_123659__12900.016.62430[139, 295]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123659__129.json50.0missing{\n "num_gpu": 99\n}missing
4963Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_083824__71100.024.32540[139, 439]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_083824__711.json50.0missing{\n "num_gpu": 99\n}missing
4964Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_123558__23100.018.76530[240, 318]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123558__231.json25.0missing{\n "num_gpu": 99\n}missing
4965Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_123626__72000.028.09381[240, 485]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123626__720.json58.3333missing{\n "num_gpu": 99\n}missing
4966Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_083759__90300.028.80191[240, 348]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083759__903.json58.3333missing{\n "num_gpu": 99\n}missing
4967Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_124027__81200.028.42960[406, 473]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124027__812.json50.0missing{\n "num_gpu": 99\n}missing
4968Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_124056__36200.028.35950[406, 469]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124056__362.json25.0missing{\n "num_gpu": 99\n}missing
4969Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_084016__30700.039.44330[406, 673]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084016__307.json50.0missing{\n "num_gpu": 99\n}missing
4970Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_123914__64800.021.03672[404, 346]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123914__648.json66.6667missing{\n "num_gpu": 99\n}missing
4971Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_123959__42600.044.73430[404, 744]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123959__426.json50.0missing{\n "num_gpu": 99\n}missing
4972Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231227_083936__66800.042.46740[404, 726]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_083936__668.json25.0missing{\n "num_gpu": 99\n}missing
4973Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_084450__96600.062.92220[104, 367]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_084450__966.json50.0missing{\n "num_gpu": 99\n}missing
4974Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_130656__36900.078.48123[104, 460]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_130656__369.json75.0missing{\n "num_gpu": 99\n}missing
4975Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_130821__42000.084.45540[104, 496]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_130821__420.json50.0missing{\n "num_gpu": 99\n}missing
4976Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_130929__14500.068.35893[104, 400]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_130929__145.json75.0missing{\n "num_gpu": 99\n}missing
4977Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_084347__35100.031.5343[143, 171]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_084347__351.json75.0missing{\n "num_gpu": 99\n}missing
4978Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_130350__58400.045.3340[143, 254]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_130350__584.json0.0missing{\n "num_gpu": 99\n}missing
4979Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_130500__82700.070.1530[143, 398]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_130500__827.json50.0missing{\n "num_gpu": 99\n}missing
4980Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_130537__69600.037.09320[143, 203]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_130537__696.json0.0missing{\n "num_gpu": 99\n}missing
4981Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_084316__51200.0139.0650[244, 652]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084316__512.json50.0missing{\n "num_gpu": 99\n}missing
4982Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_130024__97000.0107.1772[244, 540]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_130024__970.json66.6667missing{\n "num_gpu": 99\n}missing
4983Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_130129__81000.065.30520[244, 343]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_130129__810.json50.0missing{\n "num_gpu": 99\n}missing
4984Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_130304__38400.094.42541[244, 525]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_130304__384.json58.3333missing{\n "num_gpu": 99\n}missing
4985Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_084603__74800.011.70220[417, 4]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084603__748.json0.0missing{\n "num_gpu": 99\n}missing
4986Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_131547__74300.0108.1620[417, 570]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_131547__743.json50.0missing{\n "num_gpu": 99\n}missing
4987Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_131830__31800.012.17040[417, 5]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_131830__318.json0.0missing{\n "num_gpu": 99\n}missing
4988Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_084551__82700.060.44460[415, 297]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_084551__827.json50.0missing{\n "num_gpu": 99\n}missing
4989Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_131129__94100.0119.6893[415, 639]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_131129__941.json75.0missing{\n "num_gpu": 99\n}missing
4990Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_131254__68300.084.94120[415, 440]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_131254__683.json0.0missing{\n "num_gpu": 99\n}missing
4991Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_131359__72300.064.46890[415, 321]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_131359__723.json50.0missing{\n "num_gpu": 99\n}missing
4992Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231225_113346__10300.016.23120[107, 404]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_113346__103.json0.0missing{\n "num_gpu": 99\n}missing
4993Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_113406__58200.019.66711[107, 491]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_113406__582.json58.3333missing{\n "num_gpu": 99\n}missing
4994Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_083546__83300.013.36850[107, 329]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_083546__833.json50.0missing{\n "num_gpu": 99\n}missing
4995Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_113322__74300.011.24480[148, 271]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113322__743.json50.0missing{\n "num_gpu": 99\n}missing
4996Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_113329__72900.07.540251[148, 176]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113329__729.json58.3333missing{\n "num_gpu": 99\n}missing
4997Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_083532__43800.09.451030[148, 224]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_083532__438.json50.0missing{\n "num_gpu": 99\n}missing
4998Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_113253__73300.017.93690[249, 259]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113253__733.json0.0missing{\n "num_gpu": 99\n}missing
4999Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_113311__60000.017.35322[249, 409]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113311__600.json66.6667missing{\n "num_gpu": 99\n}missing
5000Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_083523__90700.016.74130[249, 243]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083523__907.json0.0missing{\n "num_gpu": 99\n}missing
5001Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113517__44300.018.00912[415, 397]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113517__443.json66.6667missing{\n "num_gpu": 99\n}missing
5002Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113528__11200.010.97232[415, 223]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113528__112.json66.6667missing{\n "num_gpu": 99\n}missing
5003Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_083621__18300.017.60332[415, 385]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083621__183.json66.6667missing{\n "num_gpu": 99\n}missing
5004Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_113441__47400.020.63633[413, 462]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113441__474.json75.0missing{\n "num_gpu": 99\n}missing
5005Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_113459__10800.017.71180[413, 390]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113459__108.json50.0missing{\n "num_gpu": 99\n}missing
5006Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_083603__57800.017.46452[413, 382]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083603__578.json66.6667missing{\n "num_gpu": 99\n}missing
5007Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231214_082657__30000.017.47220[99, 504]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_082657__300.json50.0missingmissingmissing
5008Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_094055__72800.08.922610[105, 282]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_094055__728.json50.0missing{\n "num_gpu": 99\n}missing
5009Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruefalse520231225_094106__10600.010.32150[105, 329]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_094106__106.json25.0missing{\n "num_gpu": 99\n}missing
5010Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231227_022255__49800.012.43753[105, 395]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_022255__498.json75.0missing{\n "num_gpu": 99\n}missing
5011Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231227_080715__49100.017.13031[105, 543]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_080715__491.json58.3333missing{\n "num_gpu": 99\n}missing
5012Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231214_082639__85300.019.28660[128, 545]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_082639__853.json0.0missingmissingmissing
5013Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_094035__15500.010.45090[146, 327]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_094035__155.json50.0missing{\n "num_gpu": 99\n}missing
5014Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_094046__80700.010.33842[146, 324]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_094046__807.json66.6667missing{\n "num_gpu": 99\n}missing
5015Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_022242__91100.08.538433[146, 261]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_022242__911.json75.0missing{\n "num_gpu": 99\n}missing
5016Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_080658__43700.014.54291[146, 454]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_080658__437.json58.3333missing{\n "num_gpu": 99\n}missing
5017Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231214_082620__50600.019.46110[229, 507]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082620__506.json50.0missingmissingmissing
5018Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_094010__90200.019.42560[247, 423]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094010__902.json50.0missing{\n "num_gpu": 99\n}missing
5019Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_094025__74600.014.323[247, 433]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094025__746.json75.0missing{\n "num_gpu": 99\n}missing
5020Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_022234__68100.018.71570[247, 411]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022234__681.json50.0missing{\n "num_gpu": 99\n}missing
5021Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_080643__33800.021.65273[247, 497]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_080643__338.json75.0missing{\n "num_gpu": 99\n}missing
5022Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231214_082800__69100.020.97630[11, 562]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082800__691.json25.0missingmissingmissing
5023Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_094159__79700.013.51813[413, 375]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094159__797.json75.0missing{\n "num_gpu": 99\n}missing
5024Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_094213__41700.013.80421[413, 383]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094213__417.json58.3333missing{\n "num_gpu": 99\n}missing
5025Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_022319__68800.012.61550[413, 344]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022319__688.json50.0missing{\n "num_gpu": 99\n}missing
5026Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_080741__25800.010.90033[413, 290]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_080741__258.json75.0missing{\n "num_gpu": 99\n}missing
5027Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231214_082739__90200.028.78070[399, 668]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_082739__902.json25.0missingmissingmissing
5028Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_094132__92700.011.15010[411, 300]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_094132__927.json25.0missing{\n "num_gpu": 99\n}missing
5029Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231225_094145__12700.012.86710[411, 355]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_094145__127.json0.0missing{\n "num_gpu": 99\n}missing
5030Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_022307__61800.011.70940[411, 316]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_022307__618.json50.0missing{\n "num_gpu": 99\n}missing
5031Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_080730__53000.015.1643[411, 422]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_080730__530.json75.0missing{\n "num_gpu": 99\n}missing
5032Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTtruetrue520231214_084003__40200.017.520[99, 505]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231214_084003__402.json50.0missingmissingmissing
5033Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTfalsefalse520231225_100953__27600.022.68050[102, 408]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231225_100953__276.json0.0missing{\n "num_gpu": 99\n}missing
5034Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTfalsefalse520231225_101019__22600.025.55950[102, 455]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231225_101019__226.json0.0missing{\n "num_gpu": 99\n}missing
5035Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTtruefalse520231227_082015__67900.026.68580[102, 469]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231227_082015__679.json25.0missing{\n "num_gpu": 99\n}missing
5036Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTtruetrue520231214_083945__98900.07.99130[128, 222]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_083945__989.json50.0missingmissingmissing
5037Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTtruetrue520231225_100858__87100.028.16942[141, 500]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_100858__871.json66.6667missing{\n "num_gpu": 99\n}missing
5038Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_100931__39200.032.60330[141, 578]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_100931__392.json0.0missing{\n "num_gpu": 99\n}missing
5039Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_081948__67900.018.7190[141, 327]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_081948__679.json0.0missing{\n "num_gpu": 99\n}missing
5040Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_083937__59200.026.45450[229, 687]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083937__592.json50.0missingmissingmissing
5041Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_100807__28700.032.53092[242, 389]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100807__287.json66.6667missing{\n "num_gpu": 99\n}missing
5042Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_100830__50200.022.55452[242, 379]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100830__502.json66.6667missing{\n "num_gpu": 99\n}missing
5043Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruefalse520231227_081930__71400.030.86780[242, 356]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081930__714.json25.0missing{\n "num_gpu": 99\n}missing
5044Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTtruefalse520231214_084107__15000.026.01850[11, 686]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084107__150.json25.0missingmissingmissing
5045Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTtruefalse520231225_101233__43600.029.83270[405, 475]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_101233__436.json25.0missing{\n "num_gpu": 99\n}missing
5046Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_101241__73800.08.500610[405, 96]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_101241__738.json0.0missing{\n "num_gpu": 99\n}missing
5047Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTtruetrue520231227_082125__49900.035.4591[405, 550]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_082125__499.json58.3333missing{\n "num_gpu": 99\n}missing
5048Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTfalsefalse520231214_084041__58100.022.97240[399, 524]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_084041__581.json0.0missingmissingmissing
5049Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTfalsefalse520231225_101127__97900.025.07310[402, 393]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_101127__979.json0.0missing{\n "num_gpu": 99\n}missing
5050Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTtruetrue520231225_101203__73900.035.82290[402, 578]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_101203__739.json50.0missing{\n "num_gpu": 99\n}missing
5051Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTtruetrue520231227_082049__63400.034.09510[402, 540]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_082049__634.json50.0missing{\n "num_gpu": 99\n}missing
5052Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_113705__59100.028.74920[96, 1049]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_113705__591.json0.0missing{\n "num_gpu": 99\n}missing
5053Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_113730__41800.024.68020[96, 913]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_113730__418.json0.0missing{\n "num_gpu": 99\n}missing
5054Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_083714__75500.032.55320[96, 1165]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_083714__755.json0.0missing{\n "num_gpu": 99\n}missing
5055Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_113617__37700.042.21060[133, 1463]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_113617__377.json0.0missing{\n "num_gpu": 99\n}missing
5056Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_113636__35600.018.98120[133, 704]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_113636__356.json0.0missing{\n "num_gpu": 99\n}missing
5057Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_083642__66400.015.83990[133, 588]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_083642__664.json0.0missing{\n "num_gpu": 99\n}missing
5058Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_113534__12200.05.196150[232, 31]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113534__122.json0.0missing{\n "num_gpu": 99\n}missing
5059Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_113535__49300.01.192060[232, 19]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113535__493.json0.0missing{\n "num_gpu": 99\n}missing
5060Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_083626__11300.04.567070[232, 14]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083626__113.json0.0missing{\n "num_gpu": 99\n}missing
5061Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_113834__67600.07.578780[385, 237]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113834__676.json0.0missing{\n "num_gpu": 99\n}missing
5062Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_113842__40600.08.434510[385, 268]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113842__406.json0.0missing{\n "num_gpu": 99\n}missing
5063Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_083730__70200.07.774040[385, 242]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083730__702.json0.0missing{\n "num_gpu": 99\n}missing
5064Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_113821__88900.010.36040[382, 342]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_113821__889.json0.0missing{\n "num_gpu": 99\n}missing
5065Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_113826__91100.05.174620[382, 151]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_113826__911.json0.0missing{\n "num_gpu": 99\n}missing
5066Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_083722__62100.08.221050[382, 262]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_083722__621.json0.0missing{\n "num_gpu": 99\n}missing
5067Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTtruefalse520231214_084144__12400.015.3710[99, 446]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_084144__124.json25.0missingmissingmissing
5068Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_101612__39300.035.54353[110, 270]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_101612__393.json75.0missing{\n "num_gpu": 99\n}missing
5069Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTfalsefalse520231225_101701__56500.048.22580[110, 372]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_101701__565.json0.0missing{\n "num_gpu": 99\n}missing
5070Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_082353__82100.049.69650[110, 379]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_082353__821.json50.0missing{\n "num_gpu": 99\n}missing
5071Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_084128__10300.02.416730[128, 50]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_084128__103.json50.0missingmissingmissing
5072Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_101500__54800.049.68373[149, 377]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_101500__548.json75.0missing{\n "num_gpu": 99\n}missing
5073Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_101537__31720.036.18982[149, 269]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_101537__317.json76.6667missing{\n "num_gpu": 99\n}missing
5074Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_082304__45330.046.79012[149, 349]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_082304__453.json81.6667missing{\n "num_gpu": 99\n}missing
5075Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_084126__38200.018.89910[229, 492]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084126__382.json0.0missingmissingmissing
5076Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_101328__71930.046.48922[250, 157]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_101328__719.json81.6667missing{\n "num_gpu": 99\n}missing
5077Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_101410__99530.042.47732[250, 301]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_101410__995.json81.6667missing{\n "num_gpu": 99\n}missing
5078Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_082217__71620.051.83842[250, 205]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_082217__716.json76.6667missing{\n "num_gpu": 99\n}missing
5079Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231214_084242__78900.017.57780[11, 476]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084242__789.json25.0missingmissingmissing
5080Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_102048__48800.059.0963[413, 397]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_102048__488.json75.0missing{\n "num_gpu": 99\n}missing
5081Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_102139__34400.051.57491[413, 339]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_102139__344.json58.3333missing{\n "num_gpu": 99\n}missing
5082Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_082602__80720.081.03863[413, 542]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_082602__807.json85.0missing{\n "num_gpu": 99\n}missing
5083Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231214_084224__86700.027.95230[399, 648]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_084224__867.json25.0missingmissingmissing
5084Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_101921__61200.045.29053[410, 290]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_101921__612.json75.0missing{\n "num_gpu": 99\n}missing
5085Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_101948__44620.027.29242[410, 149]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_101948__446.json76.6667missing{\n "num_gpu": 99\n}missing
5086Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_082441__22000.047.41563[410, 285]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_082441__220.json75.0missing{\n "num_gpu": 99\n}missing
5087Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_112736__62300.021.57360[107, 361]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_112736__623.json50.0missing{\n "num_gpu": 99\n}missing
5088Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_112801__27500.024.61480[107, 413]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_112801__275.json50.0missing{\n "num_gpu": 99\n}missing
5089Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_083310__44000.023.00730[107, 384]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_083310__440.json50.0missing{\n "num_gpu": 99\n}missing
5090Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_112653__98500.018.96840[148, 311]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_112653__985.json50.0missing{\n "num_gpu": 99\n}missing
5091Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_112714__71300.020.61830[148, 339]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_112714__713.json0.0missing{\n "num_gpu": 99\n}missing
5092Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_083247__86900.016.95880[148, 275]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_083247__869.json50.0missing{\n "num_gpu": 99\n}missing
5093Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_112613__74500.037.2510[249, 451]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_112613__745.json0.0missing{\n "num_gpu": 99\n}missing
5094Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_112634__99500.021.42880[249, 336]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_112634__995.json0.0missing{\n "num_gpu": 99\n}missing
5095Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_083230__49500.030.90540[249, 344]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083230__495.json0.0missing{\n "num_gpu": 99\n}missing
5096Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_112946__70000.015.32390[415, 207]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_112946__700.json50.0missing{\n "num_gpu": 99\n}missing
5097Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113011__23800.025.6090[415, 379]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113011__238.json50.0missing{\n "num_gpu": 99\n}missing
5098Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_083406__93300.019.36390[415, 274]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083406__933.json50.0missing{\n "num_gpu": 99\n}missing
5099Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_112911__70600.021.39170[413, 309]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112911__706.json25.0missing{\n "num_gpu": 99\n}missing
5100Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_112930__78900.018.81961[413, 266]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112930__789.json58.3333missing{\n "num_gpu": 99\n}missing
5101Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_083347__73500.036.90142[413, 561]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083347__735.json66.6667missing{\n "num_gpu": 99\n}missing
5102Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTtruefalse520231214_083818__89500.015.35150[99, 445]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_083818__895.json25.0missingmissingmissing
5103Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTtruetrue520231225_100647__39400.06.469860[108, 362]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_100647__394.json50.0missing{\n "num_gpu": 99\n}missing
5104Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTfalsefalse520231225_100652__86400.05.054510[108, 281]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_100652__864.json0.0missing{\n "num_gpu": 99\n}missing
5105Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTfalsefalse520231227_081839__59100.06.984250[108, 387]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_081839__591.json0.0missing{\n "num_gpu": 99\n}missing
5106Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_083803__25200.09.008630[128, 253]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_083803__252.json50.0missingmissingmissing
5107Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_100631__79500.05.043340[145, 273]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_100631__795.json0.0missing{\n "num_gpu": 99\n}missing
5108Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_100640__64700.09.258190[145, 502]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_100640__647.json0.0missing{\n "num_gpu": 99\n}missing
5109Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_081832__86000.09.346760[145, 502]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_081832__860.json0.0missing{\n "num_gpu": 99\n}missing
5110Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231214_083754__44000.019.83810[229, 517]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083754__440.json25.0missingmissingmissing
5111Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231225_100612__36500.010.35980[241, 384]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100612__365.json25.0missing{\n "num_gpu": 99\n}missing
5112Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_100626__99700.013.4850[241, 686]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100626__997.json0.0missing{\n "num_gpu": 99\n}missing
5113Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231227_081823__21900.014.03330[241, 575]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081823__219.json25.0missing{\n "num_gpu": 99\n}missing
5114Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_083911__30000.020.7680[11, 557]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083911__300.json0.0missingmissingmissing
5115Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_100727__54400.05.885150[395, 256]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100727__544.json0.0missing{\n "num_gpu": 99\n}missing
5116Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_100734__21700.07.215810[395, 325]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100734__217.json50.0missing{\n "num_gpu": 99\n}missing
5117Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_081859__65500.08.803010[395, 399]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_081859__655.json0.0missing{\n "num_gpu": 99\n}missing
5118Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_083850__17400.020.07250[399, 450]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_083850__174.json50.0missingmissingmissing
5119Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_100708__69900.07.537420[393, 339]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_100708__699.json50.0missing{\n "num_gpu": 99\n}missing
5120Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_100721__17800.013.18450[393, 618]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_100721__178.json0.0missing{\n "num_gpu": 99\n}missing
5121Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_081850__69100.010.95370[393, 502]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_081850__691.json0.0missing{\n "num_gpu": 99\n}missing
5122Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruefalse520231214_082846__84800.018.53780[99, 533]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_082846__848.json25.0missingmissingmissing
5123Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231225_094325__45600.011.32870[107, 360]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_094325__456.json50.0missing{\n "num_gpu": 99\n}missing
5124Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231225_094336__96700.010.78590[107, 344]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_094336__967.json50.0missing{\n "num_gpu": 99\n}missing
5125Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231227_022356__62300.09.94570[107, 313]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_022356__623.json50.0missing{\n "num_gpu": 99\n}missing
5126Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231227_080827__40300.013.0541[107, 413]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_080827__403.json58.3333missing{\n "num_gpu": 99\n}missing
5127Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_082827__70200.011.28280[128, 320]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_082827__702.json50.0missingmissingmissing
5128Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_094258__56700.012.01291[148, 378]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_094258__567.json58.3333missing{\n "num_gpu": 99\n}missing
5129Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_094314__76500.015.4592[148, 488]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_094314__765.json66.6667missing{\n "num_gpu": 99\n}missing
5130Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_022346__17200.011.03610[148, 342]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_022346__172.json50.0missing{\n "num_gpu": 99\n}missing
5131Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_080814__34510.011.62943[148, 360]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_080814__345.json80.0missing{\n "num_gpu": 99\n}missing
5132Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_082816__35300.016.03570[229, 414]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082816__353.json0.0missingmissingmissing
5133Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_094233__87100.019.88310[249, 430]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094233__871.json50.0missing{\n "num_gpu": 99\n}missing
5134Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_094246__99200.012.77860[249, 382]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094246__992.json50.0missing{\n "num_gpu": 99\n}missing
5135Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_022334__91300.014.95093[249, 284]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022334__913.json75.0missing{\n "num_gpu": 99\n}missing
5136Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231227_080802__11100.020.75850[249, 468]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_080802__111.json0.0missing{\n "num_gpu": 99\n}missing
5137Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231214_083012__87100.031.15160[11, 806]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083012__871.json25.0missingmissingmissing
5138Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_094442__64400.09.607810[415, 251]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094442__644.json50.0missing{\n "num_gpu": 99\n}missing
5139Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231225_094458__75000.015.67980[415, 441]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094458__750.json25.0missing{\n "num_gpu": 99\n}missing
5140Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_022422__31400.011.36911[415, 304]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022422__314.json58.3333missing{\n "num_gpu": 99\n}missing
5141Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_080902__14900.020.72691[415, 589]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_080902__149.json58.3333missing{\n "num_gpu": 99\n}missing
5142Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_082941__70700.033.69330[399, 784]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_082941__707.json50.0missingmissingmissing
5143Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_094416__37120.010.73783[413, 286]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_094416__371.json85.0missing{\n "num_gpu": 99\n}missing
5144Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_094433__31500.016.99083[413, 481]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_094433__315.json75.0missing{\n "num_gpu": 99\n}missing
5145Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_022410__20320.014.12993[413, 390]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_022410__203.json85.0missing{\n "num_gpu": 99\n}missing
5146Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_080841__55900.013.51460[413, 370]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_080841__559.json50.0missing{\n "num_gpu": 99\n}missing
5147Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruefalse520231214_083049__30800.010.03550[99, 290]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_083049__308.json25.0missingmissingmissing
5148Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruefalse520231225_094908__19400.080.50290[104, 596]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_094908__194.json25.0missing{\n "num_gpu": 99\n}missing
5149Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruetrue520231225_095001__77400.052.84730[104, 390]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_095001__774.json50.0missing{\n "num_gpu": 99\n}missing
5150Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruefalse520231227_022747__43200.077.85540[104, 580]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_022747__432.json25.0missing{\n "num_gpu": 99\n}missing
5151Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruetrue520231227_081214__19700.077.08270[104, 574]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_081214__197.json50.0missing{\n "num_gpu": 99\n}missing
5152Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_083039__37300.010.9311[128, 309]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_083039__373.json58.3333missingmissingmissing
5153Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_094701__30500.062.910[143, 451]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_094701__305.json50.0missing{\n "num_gpu": 99\n}missing
5154Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_094747__46500.045.62260[143, 329]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_094747__465.json50.0missing{\n "num_gpu": 99\n}missing
5155Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_022629__98300.063.97520[143, 470]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_022629__983.json50.0missing{\n "num_gpu": 99\n}missing
5156Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231227_081057__67700.053.42350[143, 390]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_081057__677.json0.0missing{\n "num_gpu": 99\n}missing
5157Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231214_083028__68900.015.6870[229, 405]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083028__689.json0.0missingmissingmissing
5158Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_094543__37700.044.45440[244, 121]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094543__377.json50.0missing{\n "num_gpu": 99\n}missing
5159Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_094559__24400.015.51510[244, 81]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094559__244.json50.0missing{\n "num_gpu": 99\n}missing
5160Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231227_022525__28700.063.53990[244, 278]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022525__287.json0.0missing{\n "num_gpu": 99\n}missing
5161Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231227_081002__34800.060.40463[244, 254]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081002__348.json75.0missing{\n "num_gpu": 99\n}missing
5162Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_083213__62900.020.41870[11, 548]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083213__629.json50.0missingmissingmissing
5163Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_095549__90200.079.94590[417, 517]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_095549__902.json25.0missing{\n "num_gpu": 99\n}missing
5164Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_095721__46400.092.4120[417, 604]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_095721__464.json25.0missing{\n "num_gpu": 99\n}missing
5165Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231227_022955__43900.064.38690[417, 414]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022955__439.json25.0missing{\n "num_gpu": 99\n}missing
5166Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_083152__84800.040.14860[399, 933]0.4.031.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_083152__848.json50.0missingmissingmissing
5167Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_095320__94700.069.72063[415, 451]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_095320__947.json75.0missing{\n "num_gpu": 99\n}missing
5168Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_095429__34300.068.40940[415, 435]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_095429__343.json50.0missing{\n "num_gpu": 99\n}missing
5169Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231227_022851__90000.063.71920[415, 413]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_022851__900.json50.0missing{\n "num_gpu": 99\n}missing
5170Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231227_081310__44800.056.10290[415, 357]0.6.031.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_081310__448.json50.0missing{\n "num_gpu": 99\n}missing
5171Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruefalse520231214_085001__20700.09.779530[74, 291]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_085001__207.json25.0missingmissingmissing
5172Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231225_085720__16750.015.16715[82, 277]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_085720__167.json100.0missing{\n "num_gpu": 99\n}missing
5173Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231225_085739__61350.018.83545[82, 346]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_085739__613.json100.0missing{\n "num_gpu": 99\n}missing
5174Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231227_085640__77150.020.16055[82, 368]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_085640__771.json100.0missing{\n "num_gpu": 99\n}missing
5175Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_084951__80410.07.614350[103, 215]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_084951__804.json55.0missingmissingmissing
5176Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_085703__12400.04.536120[120, 68]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_085703__124.json0.0missing{\n "num_gpu": 99\n}missing
5177Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_085705__67200.02.652830[120, 31]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_085705__672.json0.0missing{\n "num_gpu": 99\n}missing
5178Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_085619__74650.010.90735[120, 189]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_085619__746.json100.0missing{\n "num_gpu": 99\n}missing
5179Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231214_084943__31410.015.16080[201, 401]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084943__314.json55.0missingmissingmissing
5180Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_085648__27550.025.99085[219, 269]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085648__275.json100.0missing{\n "num_gpu": 99\n}missing
5181Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_085658__81300.09.720370[219, 151]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085658__813.json0.0missing{\n "num_gpu": 99\n}missing
5182Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_085608__90550.019.51265[219, 158]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085608__905.json100.0missing{\n "num_gpu": 99\n}missing
5183Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_085050__67910.011.74420[11, 326]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085050__679.json55.0missingmissingmissing
5184Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_085920__56650.025.67685[385, 407]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085920__566.json100.0missing{\n "num_gpu": 99\n}missing
5185Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_085932__52950.011.95655[385, 160]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085932__529.json100.0missing{\n "num_gpu": 99\n}missing
5186Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_085730__48410.038.08860[385, 616]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085730__484.json55.0missing{\n "num_gpu": 99\n}missing
5187Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231214_085038__60500.024.02920[374, 564]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_085038__605.json25.0missingmissingmissing
5188Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_085836__93450.022.20615[382, 350]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_085836__934.json100.0missing{\n "num_gpu": 99\n}missing
5189Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_085855__13710.018.18230[382, 278]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_085855__137.json55.0missing{\n "num_gpu": 99\n}missing
5190Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_085652__98450.012.46995[382, 172]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_085652__984.json100.0missing{\n "num_gpu": 99\n}missing
5191Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonInJulia1SHOTtruefalse520231214_085126__55700.013.66380[74, 397]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_085126__557.json25.0missingmissingmissing
5192Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonInJulia1SHOTtruefalse520231225_090019__18400.019.92420[56, 372]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_090019__184.json25.0missing{\n "num_gpu": 99\n}missing
5193Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_090022__81700.03.084420[56, 50]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_090022__817.json0.0missing{\n "num_gpu": 99\n}missing
5194Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231214_085111__98710.06.762240[103, 190]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_085111__987.json55.0missingmissingmissing
5195Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_085954__12900.06.727090[57, 121]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_085954__129.json0.0missing{\n "num_gpu": 99\n}missing
5196Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_085959__40600.04.737380[57, 82]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_085959__406.json0.0missing{\n "num_gpu": 99\n}missing
5197Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_085104__13810.014.46550[201, 382]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085104__138.json55.0missingmissingmissing
5198Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_085945__31800.012.34630[94, 30]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085945__318.json0.0missing{\n "num_gpu": 99\n}missing
5199Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_085947__76700.02.319380[94, 29]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085947__767.json0.0missing{\n "num_gpu": 99\n}missing
5200Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_085232__43110.025.98120[11, 686]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085232__431.json55.0missingmissingmissing
5201Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_090047__47400.01.216170[74, 8]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090047__474.json0.0missing{\n "num_gpu": 99\n}missing
5202Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231214_085206__85010.027.40670[374, 641]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_085206__850.json55.0missingmissingmissing
5203Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_090038__59900.03.465790[71, 52]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_090038__599.json25.0missing{\n "num_gpu": 99\n}missing
5204Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_090046__21800.07.288740[71, 126]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_090046__218.json25.0missing{\n "num_gpu": 99\n}missing
5205Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_091943__50850.039.48115[73, 237]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_091943__508.json100.0missing{\n "num_gpu": 99\n}missing
5206Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_092027__56550.043.67325[73, 263]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_092027__565.json100.0missing{\n "num_gpu": 99\n}missing
5207Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_090521__83850.026.88415[73, 157]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_090521__838.json100.0missing{\n "num_gpu": 99\n}missing
5208Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_091833__85050.038.6515[114, 226]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_091833__850.json100.0missing{\n "num_gpu": 99\n}missing
5209Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_091903__12050.030.03925[114, 172]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_091903__120.json100.0missing{\n "num_gpu": 99\n}missing
5210Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_090454__28950.031.25485[114, 179]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090454__289.json100.0missing{\n "num_gpu": 99\n}missing
5211Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_091618__59750.065.71385[212, 210]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_091618__597.json100.0missing{\n "num_gpu": 99\n}missing
5212Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_091754__22750.095.93675[212, 557]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_091754__227.json100.0missing{\n "num_gpu": 99\n}missing
5213Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_090422__83850.088.69635[212, 367]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090422__838.json100.0missing{\n "num_gpu": 99\n}missing
5214Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092419__26250.044.46275[402, 213]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092419__262.json100.0missing{\n "num_gpu": 99\n}missing
5215Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092459__26650.040.22675[402, 187]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092459__266.json100.0missing{\n "num_gpu": 99\n}missing
5216Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_090707__47450.073.06785[402, 384]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090707__474.json100.0missing{\n "num_gpu": 99\n}missing
5217Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092248__48150.051.9535[400, 258]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092248__481.json100.0missing{\n "num_gpu": 99\n}missing
5218Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092334__10150.046.12055[400, 222]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092334__101.json100.0missing{\n "num_gpu": 99\n}missing
5219Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_090554__21150.033.26635[400, 144]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_090554__211.json100.0missing{\n "num_gpu": 99\n}missing
5220Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_091356__77000.09.764890[77, 375]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_091356__770.json0.0missing{\n "num_gpu": 99\n}missing
5221Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_131925__42600.010.08010[77, 388]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_131925__426.json25.0missing{\n "num_gpu": 99\n}missing
5222Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_131934__59000.08.743970[77, 337]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_131934__590.json25.0missing{\n "num_gpu": 99\n}missing
5223Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_131942__17300.07.393120[77, 285]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_131942__173.json0.0missing{\n "num_gpu": 99\n}missing
5224Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_091346__72310.07.177030[114, 271]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_091346__723.json55.0missing{\n "num_gpu": 99\n}missing
5225Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_131858__38000.02.941650[114, 105]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_131858__380.json0.0missing{\n "num_gpu": 99\n}missing
5226Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_131907__48910.09.207550[114, 349]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_131907__489.json55.0missing{\n "num_gpu": 99\n}missing
5227Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse520231227_131915__84700.08.00690[114, 303]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_131915__847.json25.0missing{\n "num_gpu": 99\n}missing
5228Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_091339__42600.08.715120[203, 185]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091339__426.json25.0missing{\n "num_gpu": 99\n}missing
5229Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_131841__11900.011.90220[203, 299]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_131841__119.json0.0missing{\n "num_gpu": 99\n}missing
5230Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_131846__50800.04.32350[203, 146]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_131846__508.json0.0missing{\n "num_gpu": 99\n}missing
5231Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_131855__54500.09.210930[203, 332]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_131855__545.json0.0missing{\n "num_gpu": 99\n}missing
5232Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_091415__20500.08.619340[366, 278]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091415__205.json0.0missing{\n "num_gpu": 99\n}missing
5233Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_132030__95100.011.23390[366, 373]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_132030__951.json0.0missing{\n "num_gpu": 99\n}missing
5234Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_132048__14700.017.2710[366, 584]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_132048__147.json0.0missing{\n "num_gpu": 99\n}missing
5235Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_132056__62200.08.03010[366, 257]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_132056__622.json0.0missing{\n "num_gpu": 99\n}missing
5236Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_091407__36700.010.23970[363, 337]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_091407__367.json0.0missing{\n "num_gpu": 99\n}missing
5237Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_131950__41310.08.732540[363, 283]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_131950__413.json55.0missing{\n "num_gpu": 99\n}missing
5238Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_132001__27200.010.55280[363, 349]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_132001__272.json0.0missing{\n "num_gpu": 99\n}missing
5239Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_132019__45500.018.1970[363, 616]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_132019__455.json0.0missing{\n "num_gpu": 99\n}missing
5240Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruefalse520231214_084327__13500.012.02940[74, 359]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231214_084327__135.json25.0missingmissingmissing
5241Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruefalse520231225_084032__37500.013.85080[74, 410]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231225_084032__375.json25.0missing{\n "num_gpu": 99\n}missing
5242Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruefalse520231225_084042__78400.010.5490[1, 330]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231225_084042__784.json25.0missing{\n "num_gpu": 99\n}missing
5243Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruetrue520231227_084652__62310.015.33820[74, 461]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231227_084652__623.json55.0missing{\n "num_gpu": 99\n}missing
5244Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231214_084314__64110.09.364550[103, 268]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_084314__641.json55.0missingmissingmissing
5245Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231225_084009__40610.07.601190[103, 215]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_084009__406.json55.0missing{\n "num_gpu": 99\n}missing
5246Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231225_084018__26610.07.547590[1, 235]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_084018__266.json55.0missing{\n "num_gpu": 99\n}missing
5247Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231227_084636__91710.08.140640[103, 236]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_084636__917.json55.0missing{\n "num_gpu": 99\n}missing
5248Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231214_084305__28410.022.79250[201, 607]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084305__284.json55.0missingmissingmissing
5249Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231225_083948__10210.030.40590[219, 667]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_083948__102.json55.0missing{\n "num_gpu": 99\n}missing
5250Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231225_084001__82110.012.99210[1, 381]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084001__821.json55.0missing{\n "num_gpu": 99\n}missing
5251Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231227_084628__22010.025.37010[219, 554]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084628__220.json55.0missing{\n "num_gpu": 99\n}missing
5252Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruefalse520231214_084419__37700.024.35390[11, 650]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084419__377.json25.0missingmissingmissing
5253Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruetrue520231225_084207__43910.023.3770[11, 628]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084207__439.json55.0missing{\n "num_gpu": 99\n}missing
5254Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruetrue520231225_084229__38810.021.60940[1, 588]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084229__388.json55.0missing{\n "num_gpu": 99\n}missing
5255Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruetrue520231227_084733__35310.021.65280[11, 590]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084733__353.json55.0missing{\n "num_gpu": 99\n}missing
5256Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTfalsefalse520231214_084355__60900.017.67270[374, 400]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_084355__609.json0.0missingmissingmissing
5257Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTtruetrue520231225_084129__25310.024.0170[374, 564]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_084129__253.json55.0missing{\n "num_gpu": 99\n}missing
5258Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTtruetrue520231225_084144__99910.015.07350[1, 420]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_084144__999.json55.0missing{\n "num_gpu": 99\n}missing
5259Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTtruetrue520231227_084711__42510.019.36380[374, 451]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_084711__425.json55.0missing{\n "num_gpu": 99\n}missing
5260Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruefalse520231214_085312__59500.010.44090[74, 312]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231214_085312__595.json25.0missingmissingmissing
5261Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruetrue520231225_090137__86850.08.577395[74, 283]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231225_090137__868.json100.0missing{\n "num_gpu": 99\n}missing
5262Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruetrue520231225_090142__34920.05.038041[74, 161]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231225_090142__349.json65.0missing{\n "num_gpu": 99\n}missing
5263Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruefalse520231227_085758__23800.06.251180[74, 201]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231227_085758__238.json25.0missing{\n "num_gpu": 99\n}missing
5264Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruefalse520231214_085301__31000.011.61110[103, 334]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_085301__310.json25.0missingmissingmissing
5265Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruetrue520231225_090121__91520.08.940391[113, 289]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_090121__915.json65.0missing{\n "num_gpu": 99\n}missing
5266Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruetrue520231225_090128__57150.07.715555[113, 247]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_090128__571.json100.0missing{\n "num_gpu": 99\n}missing
5267Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruetrue520231227_085751__32650.06.657425[113, 209]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_085751__326.json100.0missing{\n "num_gpu": 99\n}missing
5268Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruefalse520231214_085250__75500.017.56460[201, 467]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085250__755.json25.0missingmissingmissing
5269Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_090104__64650.016.24055[211, 314]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090104__646.json100.0missing{\n "num_gpu": 99\n}missing
5270Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_090112__35950.07.446675[211, 221]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090112__359.json100.0missing{\n "num_gpu": 99\n}missing
5271Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_085745__41650.014.16515[211, 250]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085745__416.json100.0missing{\n "num_gpu": 99\n}missing
5272Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTfalsefalse520231214_085406__80600.021.08460[11, 562]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085406__806.json0.0missingmissingmissing
5273Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_090229__80520.012.4791[377, 355]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090229__805.json65.0missing{\n "num_gpu": 99\n}missing
5274Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_090237__64350.08.095495[377, 214]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090237__643.json100.0missing{\n "num_gpu": 99\n}missing
5275Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_085819__86320.010.14731[377, 278]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085819__863.json65.0missing{\n "num_gpu": 99\n}missing
5276Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruetrue520231214_085345__24710.018.32370[374, 417]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_085345__247.json55.0missingmissingmissing
5277Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruetrue520231225_090203__53220.09.945661[374, 274]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_090203__532.json65.0missing{\n "num_gpu": 99\n}missing
5278Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruefalse520231225_090216__18600.013.13220[374, 376]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_090216__186.json25.0missing{\n "num_gpu": 99\n}missing
5279Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruetrue520231227_085808__14420.010.73771[374, 297]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_085808__144.json65.0missing{\n "num_gpu": 99\n}missing
5280Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_183057__90720.014.97171[74, 289]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183057__907.json65.0missing{\n "num_gpu": 99\n}missing
5281Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_183115__63120.017.75071[74, 344]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183115__631.json65.0missing{\n "num_gpu": 99\n}missing
5282Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_183122__49020.07.119591[74, 133]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183122__490.json65.0missing{\n "num_gpu": 99\n}missing
5283Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_183009__20620.010.54851[113, 185]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183009__206.json65.0missing{\n "num_gpu": 99\n}missing
5284Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_183025__11420.015.25281[113, 290]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183025__114.json65.0missing{\n "num_gpu": 99\n}missing
5285Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_183042__88400.016.9880[113, 324]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183042__884.json25.0missing{\n "num_gpu": 99\n}missing
5286Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182930__10350.016.61865[211, 304]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182930__103.json100.0missing{\n "num_gpu": 99\n}missing
5287Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182946__12620.015.64961[211, 284]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182946__126.json65.0missing{\n "num_gpu": 99\n}missing
5288Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182959__15720.013.16171[211, 230]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182959__157.json65.0missing{\n "num_gpu": 99\n}missing
5289Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_183220__58520.010.02251[377, 154]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183220__585.json65.0missing{\n "num_gpu": 99\n}missing
5290Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_183238__40720.017.51411[377, 301]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183238__407.json65.0missing{\n "num_gpu": 99\n}missing
5291Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_183256__92900.018.34060[377, 315]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183256__929.json25.0missing{\n "num_gpu": 99\n}missing
5292Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_183138__75400.016.69350[374, 285]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183138__754.json25.0missing{\n "num_gpu": 99\n}missing
5293Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_183155__53050.016.49995[374, 280]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183155__530.json100.0missing{\n "num_gpu": 99\n}missing
5294Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_183210__51320.014.67431[374, 246]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183210__513.json65.0missing{\n "num_gpu": 99\n}missing
5295Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_092841__82310.04.747090[70, 113]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_092841__823.json55.0missing{\n "num_gpu": 99\n}missing
5296Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_092849__86410.07.489310[70, 185]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_092849__864.json55.0missing{\n "num_gpu": 99\n}missing
5297Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231227_090850__29400.011.44870[70, 286]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_090850__294.json25.0missing{\n "num_gpu": 99\n}missing
5298Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092829__48510.03.057390[111, 63]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092829__485.json55.0missing{\n "num_gpu": 99\n}missing
5299Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092836__36610.07.68750[111, 185]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092836__366.json55.0missing{\n "num_gpu": 99\n}missing
5300Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_090839__59500.03.330010[111, 70]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090839__595.json0.0missing{\n "num_gpu": 99\n}missing
5301Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_092809__49310.022.56070[209, 408]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092809__493.json55.0missing{\n "num_gpu": 99\n}missing
5302Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_092826__33310.015.92420[209, 381]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092826__333.json55.0missing{\n "num_gpu": 99\n}missing
5303Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_090835__14110.012.98020[209, 168]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090835__141.json55.0missing{\n "num_gpu": 99\n}missing
5304Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093015__36910.017.63420[378, 395]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093015__369.json55.0missing{\n "num_gpu": 99\n}missing
5305Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093023__24510.07.717220[378, 147]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093023__245.json55.0missing{\n "num_gpu": 99\n}missing
5306Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_090927__31610.026.4370[378, 605]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090927__316.json55.0missing{\n "num_gpu": 99\n}missing
5307Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092932__47310.016.34750[376, 364]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092932__473.json55.0missing{\n "num_gpu": 99\n}missing
5308Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092957__40610.025.00850[376, 576]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092957__406.json55.0missing{\n "num_gpu": 99\n}missing
5309Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_090900__70600.09.978510[376, 203]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_090900__706.json25.0missing{\n "num_gpu": 99\n}missing
5310Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004250__50110.010.83770[69, 343]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004250__501.json55.0missing{\n "num_gpu": 99\n}missing
5311Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004256__38510.06.242950[69, 193]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004256__385.json55.0missing{\n "num_gpu": 99\n}missing
5312Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004304__12450.07.638965[69, 238]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004304__124.json100.0missing{\n "num_gpu": 99\n}missing
5313Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004311__90050.06.992945[69, 218]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004311__900.json100.0missing{\n "num_gpu": 99\n}missing
5314Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004324__45910.012.93560[69, 410]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004324__459.json55.0missing{\n "num_gpu": 99\n}missing
5315Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004228__54510.02.968690[110, 78]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004228__545.json55.0missing{\n "num_gpu": 99\n}missing
5316Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004230__38610.02.648960[110, 69]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004230__386.json55.0missing{\n "num_gpu": 99\n}missing
5317Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004233__88410.02.751020[110, 72]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004233__884.json55.0missing{\n "num_gpu": 99\n}missing
5318Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004236__67150.02.804375[110, 74]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004236__671.json100.0missing{\n "num_gpu": 99\n}missing
5319Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004239__62850.03.099715[110, 84]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004239__628.json100.0missing{\n "num_gpu": 99\n}missing
5320Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_004143__49900.022.82540[208, 663]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004143__499.json25.0missing{\n "num_gpu": 99\n}missing
5321Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004152__52210.09.282330[208, 269]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004152__522.json55.0missing{\n "num_gpu": 99\n}missing
5322Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004201__70250.08.653015[208, 249]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004201__702.json100.0missing{\n "num_gpu": 99\n}missing
5323Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004212__29210.011.6640[208, 345]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004212__292.json55.0missing{\n "num_gpu": 99\n}missing
5324Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004224__34510.011.91890[208, 353]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004224__345.json55.0missing{\n "num_gpu": 99\n}missing
5325Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004440__16050.08.980665[377, 231]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004440__160.json100.0missing{\n "num_gpu": 99\n}missing
5326Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004451__78110.011.29650[377, 303]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004451__781.json55.0missing{\n "num_gpu": 99\n}missing
5327Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_004503__29400.011.44830[377, 308]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004503__294.json25.0missing{\n "num_gpu": 99\n}missing
5328Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004519__13510.016.38210[377, 459]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004519__135.json55.0missing{\n "num_gpu": 99\n}missing
5329Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004541__56210.021.9385[377, 625]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004541__562.json80.0missing{\n "num_gpu": 99\n}missing
5330Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004339__49410.015.05960[375, 419]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004339__494.json55.0missing{\n "num_gpu": 99\n}missing
5331Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004351__28910.011.34380[375, 305]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004351__289.json55.0missing{\n "num_gpu": 99\n}missing
5332Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004408__81510.016.54480[375, 464]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004408__815.json55.0missing{\n "num_gpu": 99\n}missing
5333Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004421__66110.013.00640[375, 357]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004421__661.json55.0missing{\n "num_gpu": 99\n}missing
5334Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004431__38510.010.08790[375, 266]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004431__385.json55.0missing{\n "num_gpu": 99\n}missing
5335Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004736__31710.08.154330[69, 200]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004736__317.json55.0missing{\n "num_gpu": 99\n}missing
5336Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004747__13710.010.20720[69, 253]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004747__137.json55.0missing{\n "num_gpu": 99\n}missing
5337Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004756__35210.09.437060[69, 233]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004756__352.json55.0missing{\n "num_gpu": 99\n}missing
5338Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004805__99610.08.284050[69, 203]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004805__996.json55.0missing{\n "num_gpu": 99\n}missing
5339Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004812__36610.07.457340[69, 182]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004812__366.json55.0missing{\n "num_gpu": 99\n}missing
5340Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004710__18710.06.891940[110, 162]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004710__187.json55.0missing{\n "num_gpu": 99\n}missing
5341Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004713__97010.03.389110[110, 71]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004713__970.json55.0missing{\n "num_gpu": 99\n}missing
5342Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004717__87610.03.778850[110, 81]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004717__876.json55.0missing{\n "num_gpu": 99\n}missing
5343Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004724__38510.06.846710[110, 161]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004724__385.json55.0missing{\n "num_gpu": 99\n}missing
5344Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004728__85310.03.893850[110, 84]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004728__853.json55.0missing{\n "num_gpu": 99\n}missing
5345Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004548__66210.07.208530[208, 135]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004548__662.json55.0missing{\n "num_gpu": 99\n}missing
5346Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004606__96610.017.55580[208, 417]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004606__966.json55.0missing{\n "num_gpu": 99\n}missing
5347Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004622__13310.015.63030[208, 369]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004622__133.json55.0missing{\n "num_gpu": 99\n}missing
5348Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004645__97010.023.14090[208, 555]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004645__970.json55.0missing{\n "num_gpu": 99\n}missing
5349Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_004703__18300.017.83310[208, 424]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004703__183.json0.0missing{\n "num_gpu": 99\n}missing
5350Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005002__99210.018.1050[377, 402]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005002__992.json55.0missing{\n "num_gpu": 99\n}missing
5351Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005014__87710.012.20090[377, 257]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005014__877.json55.0missing{\n "num_gpu": 99\n}missing
5352Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005026__18710.011.76970[377, 246]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005026__187.json55.0missing{\n "num_gpu": 99\n}missing
5353Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005037__25010.010.91940[377, 225]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005037__250.json55.0missing{\n "num_gpu": 99\n}missing
5354Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005051__28850.013.49445[377, 288]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005051__288.json100.0missing{\n "num_gpu": 99\n}missing
5355Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004825__60510.012.35830[375, 261]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004825__605.json55.0missing{\n "num_gpu": 99\n}missing
5356Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_004842__95700.017.4870[375, 387]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004842__957.json25.0missing{\n "num_gpu": 99\n}missing
5357Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004901__24010.018.46390[375, 411]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004901__240.json55.0missing{\n "num_gpu": 99\n}missing
5358Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004925__92610.024.03785[375, 546]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004925__926.json80.0missing{\n "num_gpu": 99\n}missing
5359Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004944__46310.019.07110[375, 426]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004944__463.json55.0missing{\n "num_gpu": 99\n}missing
5360Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_124148__51310.09.987670[69, 180]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124148__513.json55.0missing{\n "num_gpu": 99\n}missing
5361Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_124159__80810.011.04990[69, 197]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124159__808.json55.0missing{\n "num_gpu": 99\n}missing
5362Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_091234__23010.011.65930[69, 211]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_091234__230.json55.0missing{\n "num_gpu": 99\n}missing
5363Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_124133__44910.04.072620[110, 64]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124133__449.json55.0missing{\n "num_gpu": 99\n}missing
5364Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_124138__51150.05.017715[110, 82]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124138__511.json100.0missing{\n "num_gpu": 99\n}missing
5365Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_091222__92510.04.250230[110, 67]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_091222__925.json55.0missing{\n "num_gpu": 99\n}missing
5366Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_124121__13610.025.3295[208, 448]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124121__136.json80.0missing{\n "num_gpu": 99\n}missing
5367Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_124129__75000.07.563310[208, 120]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124129__750.json25.0missing{\n "num_gpu": 99\n}missing
5368Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_091218__85610.031.07740[208, 394]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091218__856.json55.0missing{\n "num_gpu": 99\n}missing
5369Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_124344__59710.019.04550[377, 310]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124344__597.json55.0missing{\n "num_gpu": 99\n}missing
5370Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_124431__80600.047.06130[377, 735]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124431__806.json25.0missing{\n "num_gpu": 99\n}missing
5371Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_091330__33450.031.16925[377, 531]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091330__334.json100.0missing{\n "num_gpu": 99\n}missing
5372Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_124249__48010.011.17450[375, 167]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124249__480.json55.0missing{\n "num_gpu": 99\n}missing
5373Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_124324__83710.035.40755[375, 598]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124324__837.json80.0missing{\n "num_gpu": 99\n}missing
5374Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231227_091259__67710.025.08540[375, 421]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_091259__677.json55.0missing{\n "num_gpu": 99\n}missing
5375Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_091715__49510.056.37070[75, 333]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_091715__495.json55.0missing{\n "num_gpu": 99\n}missing
5376Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_132525__32500.050.0380[75, 295]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_132525__325.json25.0missing{\n "num_gpu": 99\n}missing
5377Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_132559__98350.033.70195[75, 195]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_132559__983.json100.0missing{\n "num_gpu": 99\n}missing
5378Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_132637__76610.037.7660[75, 220]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_132637__766.json55.0missing{\n "num_gpu": 99\n}missing
5379Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_091619__23310.053.86780[114, 312]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_091619__233.json55.0missing{\n "num_gpu": 99\n}missing
5380Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_132350__31510.046.21780[114, 266]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_132350__315.json55.0missing{\n "num_gpu": 99\n}missing
5381Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_132406__97610.016.24750[114, 82]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_132406__976.json55.0missing{\n "num_gpu": 99\n}missing
5382Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_132435__21810.028.88710[114, 160]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_132435__218.json55.0missing{\n "num_gpu": 99\n}missing
5383Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_091525__84150.069.71175[210, 251]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091525__841.json100.0missing{\n "num_gpu": 99\n}missing
5384Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_132208__32210.072.8150[210, 380]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_132208__322.json55.0missing{\n "num_gpu": 99\n}missing
5385Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_132231__69300.022.25390[210, 104]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_132231__693.json0.0missing{\n "num_gpu": 99\n}missing
5386Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_132304__85700.032.56020[210, 167]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_132304__857.json0.0missing{\n "num_gpu": 99\n}missing
5387Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_091914__16310.070.32831[388, 358]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091914__163.json60.0missing{\n "num_gpu": 99\n}missing
5388Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_133009__26900.011.0370[388, 5]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133009__269.json0.0missing{\n "num_gpu": 99\n}missing
5389Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_133111__38110.061.73470[388, 308]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133111__381.json55.0missing{\n "num_gpu": 99\n}missing
5390Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_133225__10810.074.72230[388, 384]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133225__108.json55.0missing{\n "num_gpu": 99\n}missing
5391Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_091803__51010.047.98295[386, 226]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_091803__510.json80.0missing{\n "num_gpu": 99\n}missing
5392Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_132738__13250.061.37555[386, 306]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_132738__132.json100.0missing{\n "num_gpu": 99\n}missing
5393Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_132844__67500.065.96280[386, 333]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_132844__675.json25.0missing{\n "num_gpu": 99\n}missing
5394Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_132958__31010.073.28950[386, 376]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_132958__310.json55.0missing{\n "num_gpu": 99\n}missing
5395Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_093115__38740.08.512724[78, 211]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_093115__387.json90.0missing{\n "num_gpu": 99\n}missing
5396Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_093121__99550.06.331915[78, 154]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_093121__995.json100.0missing{\n "num_gpu": 99\n}missing
5397Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_090954__14250.05.111815[78, 121]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_090954__142.json100.0missing{\n "num_gpu": 99\n}missing
5398Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_093100__66550.06.525835[119, 154]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_093100__665.json100.0missing{\n "num_gpu": 99\n}missing
5399Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_093106__44910.06.333450[119, 149]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_093106__449.json55.0missing{\n "num_gpu": 99\n}missing
5400Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_090949__82850.03.190255[119, 66]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090949__828.json100.0missing{\n "num_gpu": 99\n}missing
5401Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_093042__26850.018.7525[217, 296]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093042__268.json100.0missing{\n "num_gpu": 99\n}missing
5402Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_093053__82750.011.50985[217, 268]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093053__827.json100.0missing{\n "num_gpu": 99\n}missing
5403Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_090946__63840.018.91964[217, 303]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090946__638.json90.0missing{\n "num_gpu": 99\n}missing
5404Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093225__85650.010.32645[386, 209]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093225__856.json100.0missing{\n "num_gpu": 99\n}missing
5405Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093230__43510.05.183870[386, 78]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093230__435.json55.0missing{\n "num_gpu": 99\n}missing
5406Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_091023__93110.013.81860[386, 294]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091023__931.json55.0missing{\n "num_gpu": 99\n}missing
5407Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_093207__55240.019.30374[384, 435]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_093207__552.json90.0missing{\n "num_gpu": 99\n}missing
5408Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_093214__74650.07.17395[384, 133]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_093214__746.json100.0missing{\n "num_gpu": 99\n}missing
5409Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_091009__67010.014.70930[384, 320]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_091009__670.json55.0missing{\n "num_gpu": 99\n}missing
5410Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231214_084452__10310.011.73720[74, 349]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_084452__103.json55.0missingmissingmissing
5411Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_084329__96810.012.01580[76, 391]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_084329__968.json55.0missing{\n "num_gpu": 99\n}missing
5412Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_084334__87110.04.566780[76, 141]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_084334__871.json55.0missing{\n "num_gpu": 99\n}missing
5413Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231227_084805__90450.05.71735[76, 179]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_084805__904.json100.0missing{\n "num_gpu": 99\n}missing
5414Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_084440__34710.08.580270[103, 245]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_084440__347.json55.0missingmissingmissing
5415Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_084311__31110.04.380590[117, 130]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_084311__311.json55.0missing{\n "num_gpu": 99\n}missing
5416Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_084317__20620.05.409215[117, 165]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_084317__206.json85.0missing{\n "num_gpu": 99\n}missing
5417Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_084800__74110.04.277260[117, 125]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_084800__741.json55.0missing{\n "num_gpu": 99\n}missing
5418Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231214_084431__77810.012.16760[201, 317]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084431__778.json55.0missingmissingmissing
5419Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231225_084307__79800.013.88970[215, 426]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084307__798.json25.0missing{\n "num_gpu": 99\n}missing
5420Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_084755__61350.022.06785[215, 523]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084755__613.json100.0missing{\n "num_gpu": 99\n}missing
5421Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231214_084542__31700.011.43920[11, 318]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084542__317.json0.0missingmissingmissing
5422Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_084431__93610.014.31540[384, 407]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084431__936.json55.0missing{\n "num_gpu": 99\n}missing
5423Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_084450__10500.019.15790[384, 557]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084450__105.json25.0missing{\n "num_gpu": 99\n}missing
5424Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_084832__24150.014.80275[384, 418]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084832__241.json100.0missing{\n "num_gpu": 99\n}missing
5425Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231214_084531__49110.022.77110[374, 532]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_084531__491.json55.0missingmissingmissing
5426Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_084409__38110.010.07540[382, 273]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_084409__381.json55.0missing{\n "num_gpu": 99\n}missing
5427Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_084416__99010.06.748940[382, 166]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_084416__990.json55.0missing{\n "num_gpu": 99\n}missing
5428Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_084817__98800.011.70320[382, 321]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_084817__988.json50.0missing{\n "num_gpu": 99\n}missing
5429Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruefalse520231214_085646__46500.010.65280[74, 318]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231214_085646__465.json25.0missingmissingmissing
5430Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231225_090453__40650.014.31165[77, 260]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231225_090453__406.json100.0missing{\n "num_gpu": 99\n}missing
5431Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231225_090503__15250.09.373745[77, 166]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231225_090503__152.json100.0missing{\n "num_gpu": 99\n}missing
5432Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231227_085925__62450.09.81625[77, 173]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231227_085925__624.json100.0missing{\n "num_gpu": 99\n}missing
5433Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_085635__50010.08.319860[103, 236]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_085635__500.json55.0missingmissingmissing
5434Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_090436__45600.02.929990[116, 37]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_090436__456.json0.0missing{\n "num_gpu": 99\n}missing
5435Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_090439__31300.03.321450[116, 44]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_090439__313.json0.0missing{\n "num_gpu": 99\n}missing
5436Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTtruetrue520231227_085915__24220.014.47341[116, 255]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_085915__242.json65.0missing{\n "num_gpu": 99\n}missing
5437Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_085626__93210.020.82740[201, 555]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085626__932.json55.0missingmissingmissing
5438Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_090408__65800.016.71170[214, 106]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090408__658.json0.0missing{\n "num_gpu": 99\n}missing
5439Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_090433__38640.025.10494[214, 434]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090433__386.json90.0missing{\n "num_gpu": 99\n}missing
5440Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231227_085900__13300.013.68470[214, 52]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085900__133.json0.0missing{\n "num_gpu": 99\n}missing
5441Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_085733__70110.016.05750[11, 440]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085733__701.json55.0missingmissingmissing
5442Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_090648__78710.026.26030[380, 420]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090648__787.json55.0missing{\n "num_gpu": 99\n}missing
5443Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_090717__11540.028.86974[380, 465]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090717__115.json90.0missing{\n "num_gpu": 99\n}missing
5444Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231227_085953__72810.016.11630[380, 238]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085953__728.json55.0missing{\n "num_gpu": 99\n}missing
5445Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTtruetrue520231214_085717__98210.021.2940[374, 495]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_085717__982.json55.0missingmissingmissing
5446Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_090544__91900.020.86840[377, 325]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_090544__919.json0.0missing{\n "num_gpu": 99\n}missing
5447Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTtruefalse520231225_090621__80400.037.58610[377, 615]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_090621__804.json25.0missing{\n "num_gpu": 99\n}missing
5448Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_085937__71400.012.05770[377, 165]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_085937__714.json0.0missing{\n "num_gpu": 99\n}missing
5449Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231225_093427__31100.018.25860[71, 695]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_093427__311.json25.0missing{\n "num_gpu": 99\n}missing
5450Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_093441__44800.013.51810[71, 521]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_093441__448.json0.0missing{\n "num_gpu": 99\n}missing
5451Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_091115__92800.018.52060[71, 697]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_091115__928.json0.0missing{\n "num_gpu": 99\n}missing
5452Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231225_093334__71200.028.60520[108, 1041]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_093334__712.json25.0missing{\n "num_gpu": 99\n}missing
5453Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse520231225_093409__21000.034.58770[108, 1235]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_093409__210.json25.0missing{\n "num_gpu": 99\n}missing
5454Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_091057__51500.023.81230[108, 872]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_091057__515.json0.0missing{\n "num_gpu": 99\n}missing
5455Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_093236__94300.05.665030[197, 54]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093236__943.json0.0missing{\n "num_gpu": 99\n}missing
5456Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_093305__13700.029.57080[197, 1045]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093305__137.json0.0missing{\n "num_gpu": 99\n}missing
5457Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_091033__25900.010.05130[197, 233]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091033__259.json0.0missing{\n "num_gpu": 99\n}missing
5458Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_093610__60400.04.215130[360, 117]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093610__604.json0.0missing{\n "num_gpu": 99\n}missing
5459Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231225_093618__25910.07.872150[360, 254]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093618__259.json55.0missing{\n "num_gpu": 99\n}missing
5460Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_091147__13900.023.32380[360, 787]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091147__139.json0.0missing{\n "num_gpu": 99\n}missing
5461Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231225_093602__97810.08.893390[357, 291]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_093602__978.json55.0missing{\n "num_gpu": 99\n}missing
5462Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_093605__40800.03.378040[357, 84]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_093605__408.json0.0missing{\n "num_gpu": 99\n}missing
5463Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231227_091123__46110.08.099560[357, 260]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_091123__461.json55.0missing{\n "num_gpu": 99\n}missing
5464Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruefalse520231214_085819__41800.012.59250[74, 374]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_085819__418.json25.0missingmissingmissing
5465Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_091025__61650.040.26285[85, 314]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_091025__616.json100.0missing{\n "num_gpu": 99\n}missing
5466Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_091047__23250.021.64645[85, 162]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_091047__232.json100.0missing{\n "num_gpu": 99\n}missing
5467Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_090137__38750.020.22265[85, 150]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_090137__387.json100.0missing{\n "num_gpu": 99\n}missing
5468Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_085807__81110.010.57120[103, 304]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_085807__811.json55.0missingmissingmissing
5469Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_090919__13410.023.83520[124, 175]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_090919__134.json55.0missing{\n "num_gpu": 99\n}missing
5470Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_090945__49450.025.85325[124, 191]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_090945__494.json100.0missing{\n "num_gpu": 99\n}missing
5471Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_090117__20450.033.10745[124, 248]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_090117__204.json100.0missing{\n "num_gpu": 99\n}missing
5472Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231214_085756__40110.022.45530[201, 597]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085756__401.json55.0missingmissingmissing
5473Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_090809__43550.051.86285[222, 206]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090809__435.json100.0missing{\n "num_gpu": 99\n}missing
5474Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_090855__93150.045.97555[222, 335]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090855__931.json100.0missing{\n "num_gpu": 99\n}missing
5475Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_090044__97750.050.98885[222, 208]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090044__977.json100.0missing{\n "num_gpu": 99\n}missing
5476Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231214_085923__10010.015.75390[11, 432]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085923__100.json55.0missingmissingmissing
5477Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_091418__73450.027.385[388, 153]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_091418__734.json100.0missing{\n "num_gpu": 99\n}missing
5478Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_091512__29330.053.7634[388, 360]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_091512__293.json85.0missing{\n "num_gpu": 99\n}missing
5479Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_090254__42450.033.87495[388, 203]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090254__424.json100.0missing{\n "num_gpu": 99\n}missing
5480Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_085908__23710.030.64260[374, 726]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_085908__237.json55.0missingmissingmissing
5481Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_091314__80950.043.25965[385, 278]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_091314__809.json100.0missing{\n "num_gpu": 99\n}missing
5482Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_091351__70150.037.29545[385, 231]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_091351__701.json100.0missing{\n "num_gpu": 99\n}missing
5483Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231227_090220__89000.042.3940[385, 270]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_090220__890.json25.0missing{\n "num_gpu": 99\n}missing
5484Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_092609__46410.016.01920[78, 271]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_092609__464.json55.0missing{\n "num_gpu": 99\n}missing
5485Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_092614__62550.05.109485[78, 78]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_092614__625.json100.0missing{\n "num_gpu": 99\n}missing
5486Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_090745__88110.05.367290[78, 82]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_090745__881.json55.0missing{\n "num_gpu": 99\n}missing
5487Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092546__56910.015.02220[119, 248]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092546__569.json55.0missing{\n "num_gpu": 99\n}missing
5488Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092553__54310.07.011940[119, 107]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092553__543.json55.0missing{\n "num_gpu": 99\n}missing
5489Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_090740__78150.011.83925[119, 191]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090740__781.json100.0missing{\n "num_gpu": 99\n}missing
5490Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_092522__95210.022.48480[217, 199]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092522__952.json55.0missing{\n "num_gpu": 99\n}missing
5491Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_092531__46700.08.994210[217, 128]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092531__467.json25.0missing{\n "num_gpu": 99\n}missing
5492Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_090728__25300.020.1080[217, 171]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090728__253.json25.0missing{\n "num_gpu": 99\n}missing
5493Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092728__57010.010.29030[386, 123]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092728__570.json55.0missing{\n "num_gpu": 99\n}missing
5494Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092747__14510.019.12970[386, 273]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092747__145.json55.0missing{\n "num_gpu": 99\n}missing
5495Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_090822__61650.017.3725[386, 242]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090822__616.json100.0missing{\n "num_gpu": 99\n}missing
5496Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092654__33310.018.05660[384, 259]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092654__333.json55.0missing{\n "num_gpu": 99\n}missing
5497Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092717__70710.022.64620[384, 336]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092717__707.json55.0missing{\n "num_gpu": 99\n}missing
5498Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_090805__23310.019.87790[384, 288]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_090805__233.json55.0missing{\n "num_gpu": 99\n}missing
5499Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTtruefalse520231214_085448__70400.016.92890[74, 498]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_085448__704.json25.0missingmissingmissing
5500Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTfalsefalse520231225_090307__93000.05.827860[81, 334]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_090307__930.json0.0missing{\n "num_gpu": 99\n}missing
5501Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTtruefalse520231225_090313__67300.05.984950[81, 344]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_090313__673.json25.0missing{\n "num_gpu": 99\n}missing
5502Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTfalsefalse520231227_085834__97000.03.676440[81, 207]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_085834__970.json0.0missing{\n "num_gpu": 99\n}missing
5503Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_085431__45910.07.067110[103, 199]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_085431__459.json55.0missingmissingmissing
5504Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231225_090300__60010.03.482620[118, 193]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_090300__600.json55.0missing{\n "num_gpu": 99\n}missing
5505Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_090302__70500.01.41020[118, 69]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_090302__705.json0.0missing{\n "num_gpu": 99\n}missing
5506Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231227_085830__86810.01.639070[118, 81]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_085830__868.json55.0missing{\n "num_gpu": 99\n}missing
5507Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_085424__83610.017.39310[201, 462]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085424__836.json55.0missingmissingmissing
5508Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_090248__36700.010.92440[204, 426]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090248__367.json0.0missing{\n "num_gpu": 99\n}missing
5509Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231225_090256__97910.08.609650[204, 454]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090256__979.json55.0missing{\n "num_gpu": 99\n}missing
5510Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231227_085828__61010.09.592170[204, 361]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085828__610.json55.0missing{\n "num_gpu": 99\n}missing
5511Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231214_085605__29300.039.84870[11, 1010]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085605__293.json25.0missingmissingmissing
5512Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_090347__91410.06.354570[368, 291]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090347__914.json55.0missing{\n "num_gpu": 99\n}missing
5513Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_090351__21910.03.952710[368, 162]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090351__219.json55.0missing{\n "num_gpu": 99\n}missing
5514Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231227_085846__44610.05.357380[368, 235]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085846__446.json55.0missing{\n "num_gpu": 99\n}missing
5515Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_085526__94310.020.16780[374, 465]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_085526__943.json55.0missingmissingmissing
5516Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_090336__14400.08.913530[366, 422]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_090336__144.json0.0missing{\n "num_gpu": 99\n}missing
5517Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_090340__68310.03.810810[366, 154]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_090340__683.json55.0missing{\n "num_gpu": 99\n}missing
5518Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231227_085841__10500.07.376990[366, 339]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_085841__105.json25.0missing{\n "num_gpu": 99\n}missing
5519Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruefalse520231214_084634__35900.016.87860[74, 497]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_084634__359.json25.0missingmissingmissing
5520Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231225_084553__57810.015.10580[78, 491]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_084553__578.json55.0missing{\n "num_gpu": 99\n}missing
5521Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231225_084601__63250.08.181645[78, 263]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_084601__632.json100.0missing{\n "num_gpu": 99\n}missing
5522Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231227_084911__78010.010.82210[78, 345]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_084911__780.json55.0missing{\n "num_gpu": 99\n}missing
5523Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_084617__75110.013.20750[103, 381]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_084617__751.json55.0missingmissingmissing
5524Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_084528__42150.06.176345[119, 190]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_084528__421.json100.0missing{\n "num_gpu": 99\n}missing
5525Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_084537__79410.09.132680[119, 288]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_084537__794.json55.0missing{\n "num_gpu": 99\n}missing
5526Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_084900__31410.06.865980[119, 211]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_084900__314.json55.0missing{\n "num_gpu": 99\n}missing
5527Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231214_084604__21610.021.9030[201, 583]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084604__216.json55.0missingmissingmissing
5528Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_084514__94910.024.22350[217, 582]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084514__949.json55.0missing{\n "num_gpu": 99\n}missing
5529Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_084522__41310.07.690810[217, 223]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084522__413.json55.0missing{\n "num_gpu": 99\n}missing
5530Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_084853__82110.021.02020[217, 483]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084853__821.json55.0missing{\n "num_gpu": 99\n}missing
5531Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_084756__85600.028.90250[11, 760]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084756__856.json0.0missingmissingmissing
5532Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_084649__60750.012.04545[386, 330]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084649__607.json100.0missing{\n "num_gpu": 99\n}missing
5533Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_084659__18150.09.241055[386, 241]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084659__181.json100.0missing{\n "num_gpu": 99\n}missing
5534Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_084932__15550.011.845[386, 321]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084932__155.json100.0missing{\n "num_gpu": 99\n}missing
5535Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_084727__24610.044.940[374, 1054]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_084727__246.json55.0missingmissingmissing
5536Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_084626__84450.08.217175[384, 212]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_084626__844.json100.0missing{\n "num_gpu": 99\n}missing
5537Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_084637__91650.010.75265[384, 294]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_084637__916.json100.0missing{\n "num_gpu": 99\n}missing
5538Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_084921__44450.09.606025[384, 255]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_084921__444.json100.0missing{\n "num_gpu": 99\n}missing
5539Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruefalse520231214_084830__81700.010.07610[74, 300]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_084830__817.json25.0missingmissingmissing
5540Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruefalse520231225_085024__65000.063.46360[75, 482]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_085024__650.json25.0missing{\n "num_gpu": 99\n}missing
5541Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruetrue520231225_085138__75810.074.57380[75, 565]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_085138__758.json55.0missing{\n "num_gpu": 99\n}missing
5542Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruefalse520231227_085217__46200.071.45760[75, 538]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_085217__462.json25.0missing{\n "num_gpu": 99\n}missing
5543Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_084820__25910.07.674460[103, 218]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_084820__259.json55.0missingmissingmissing
5544Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_084857__60610.013.36240[114, 86]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_084857__606.json55.0missing{\n "num_gpu": 99\n}missing
5545Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_084920__37610.022.58130[114, 159]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_084920__376.json55.0missing{\n "num_gpu": 99\n}missing
5546Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_085105__94310.049.46960[114, 365]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_085105__943.json55.0missing{\n "num_gpu": 99\n}missing
5547Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_084812__38410.015.90290[201, 422]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084812__384.json55.0missingmissingmissing
5548Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_084819__59610.080.54850[210, 404]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084819__596.json55.0missing{\n "num_gpu": 99\n}missing
5549Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_084844__58210.024.18540[210, 154]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084844__582.json55.0missing{\n "num_gpu": 99\n}missing
5550Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231227_085016__93400.043.0310[210, 126]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085016__934.json0.0missing{\n "num_gpu": 99\n}missing
5551Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_084928__61710.024.77520[11, 659]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084928__617.json55.0missingmissingmissing
5552Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_085506__92410.019.59450[388, 86]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085506__924.json55.0missing{\n "num_gpu": 99\n}missing
5553Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_085622__22410.075.65690[388, 505]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085622__224.json55.0missing{\n "num_gpu": 99\n}missing
5554Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231227_085549__17000.0129.0410[388, 879]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085549__170.json25.0missing{\n "num_gpu": 99\n}missing
5555Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_084903__32610.020.82510[374, 481]0.4.051.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_084903__326.json55.0missingmissingmissing
5556Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_085407__34750.024.98735[386, 127]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_085407__347.json100.0missing{\n "num_gpu": 99\n}missing
5557Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_085447__33910.039.29920[386, 236]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_085447__339.json55.0missing{\n "num_gpu": 99\n}missing
5558Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruefalse520231227_085339__37000.082.83390[386, 552]0.6.051.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_085339__370.json25.0missing{\n "num_gpu": 99\n}missing
5559Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruefalse620231214_090625__33500.09.720510[65, 290]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_090625__335.json25.0missingmissingmissing
5560Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruetrue620231225_073136__44810.020.84662[73, 377]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_073136__448.json79.1667missing{\n "num_gpu": 99\n}missing
5561Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruetrue620231225_073148__21650.011.9692[73, 212]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_073148__216.json95.8333missing{\n "num_gpu": 99\n}missing
5562Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruetrue620231227_092722__15350.09.926892[73, 176]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_092722__153.json95.8333missing{\n "num_gpu": 99\n}missing
5563Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTtruefalse620231214_090616__45300.012.61590[94, 369]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_090616__453.json25.0missingmissingmissing
5564Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue620231225_073109__39350.08.436322[111, 140]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_073109__393.json95.8333missing{\n "num_gpu": 99\n}missing
5565Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse620231225_073116__34000.06.422570[111, 103]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_073116__340.json0.0missing{\n "num_gpu": 99\n}missing
5566Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse620231227_092712__71200.07.362740[111, 122]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_092712__712.json0.0missing{\n "num_gpu": 99\n}missing
5567Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse620231214_090603__29700.015.43160[175, 418]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090603__297.json25.0missingmissingmissing
5568Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue620231225_073047__98900.023.07350[193, 190]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073047__989.json50.0missing{\n "num_gpu": 99\n}missing
5569Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue620231225_073100__72050.013.66612[193, 218]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073100__720.json95.8333missing{\n "num_gpu": 99\n}missing
5570Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue620231227_092705__25950.024.76192[193, 257]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092705__259.json95.8333missing{\n "num_gpu": 99\n}missing
5571Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse620231214_090727__32300.016.92420[11, 463]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090727__323.json0.0missingmissingmissing
5572Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue620231225_073320__58900.016.33732[376, 239]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073320__589.json75.0missing{\n "num_gpu": 99\n}missing
5573Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse620231225_073341__24300.020.81040[376, 319]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073341__243.json0.0missing{\n "num_gpu": 99\n}missing
5574Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue620231227_092748__73250.013.49912[376, 192]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092748__732.json95.8333missing{\n "num_gpu": 99\n}missing
5575Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231214_090710__19000.027.87370[365, 662]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_090710__190.json50.0missingmissingmissing
5576Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231225_073242__87820.017.45112[373, 259]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_073242__878.json83.3333missing{\n "num_gpu": 99\n}missing
5577Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231225_073304__75400.021.38410[373, 327]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_073304__754.json50.0missing{\n "num_gpu": 99\n}missing
5578Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231227_092735__95300.012.15841[373, 168]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_092735__953.json62.5missing{\n "num_gpu": 99\n}missing
5579Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonInJulia1SHOTtruefalse620231214_090808__67700.012.37960[65, 368]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_090808__677.json25.0missingmissingmissing
5580Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonInJulia1SHOTtruetrue620231225_073421__12900.07.842522[47, 139]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_073421__129.json75.0missing{\n "num_gpu": 99\n}missing
5581Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonInJulia1SHOTfalsefalse620231225_073432__39700.011.00380[47, 194]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_073432__397.json0.0missing{\n "num_gpu": 99\n}missing
5582Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse620231214_090756__94500.010.70070[94, 313]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_090756__945.json25.0missingmissingmissing
5583Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue620231225_073408__77100.07.260650[48, 127]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_073408__771.json50.0missing{\n "num_gpu": 99\n}missing
5584Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse620231225_073413__57900.05.045070[48, 86]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_073413__579.json25.0missing{\n "num_gpu": 99\n}missing
5585Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue620231214_090745__66000.017.57960[175, 478]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090745__660.json50.0missingmissingmissing
5586Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse620231225_073355__35200.013.19160[68, 45]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073355__352.json0.0missing{\n "num_gpu": 99\n}missing
5587Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse620231225_073401__66100.06.373260[68, 107]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073401__661.json0.0missing{\n "num_gpu": 99\n}missing
5588Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse620231214_090853__12000.010.75160[11, 297]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090853__120.json0.0missingmissingmissing
5589Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse620231225_073448__91200.01.306620[65, 9]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073448__912.json0.0missing{\n "num_gpu": 99\n}missing
5590Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse620231225_073502__74400.013.32980[65, 210]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073502__744.json0.0missing{\n "num_gpu": 99\n}missing
5591Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapTask1SHOTtruetrue620231214_090842__84600.019.3581[365, 447]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_090842__846.json62.5missingmissingmissing
5592Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapTask1SHOTtruefalse620231225_073446__92400.06.066320[62, 103]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_073446__924.json25.0missing{\n "num_gpu": 99\n}missing
5593Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse620231225_073447__38200.01.066260[62, 8]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_073447__382.json0.0missing{\n "num_gpu": 99\n}missing
5594Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_075628__84800.059.02521[65, 328]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_075628__848.json62.5missing{\n "num_gpu": 99\n}missing
5595Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_075713__90200.043.76981[65, 233]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_075713__902.json62.5missing{\n "num_gpu": 99\n}missing
5596Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue620231227_093836__43900.064.29131[65, 391]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_093836__439.json62.5missing{\n "num_gpu": 99\n}missing
5597Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_075417__62100.060.21851[106, 321]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_075417__621.json62.5missing{\n "num_gpu": 99\n}missing
5598Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse620231225_075528__67000.069.91390[106, 402]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_075528__670.json25.0missing{\n "num_gpu": 99\n}missing
5599Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_093731__25800.093.34680[106, 561]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_093731__258.json50.0missing{\n "num_gpu": 99\n}missing
5600Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620231225_075209__62200.080.53250[187, 273]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_075209__622.json25.0missing{\n "num_gpu": 99\n}missing
5601Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_075314__78000.064.19210[187, 363]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_075314__780.json50.0missing{\n "num_gpu": 99\n}missing
5602Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_093557__86400.058.44941[187, 187]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_093557__864.json62.5missing{\n "num_gpu": 99\n}missing
5603Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_080319__12500.086.0191[394, 444]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080319__125.json62.5missing{\n "num_gpu": 99\n}missing
5604Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_080438__66360.077.03062[394, 385]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080438__663.json100.0missing{\n "num_gpu": 99\n}missing
5605Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_094112__11130.055.56842[394, 279]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094112__111.json87.5missing{\n "num_gpu": 99\n}missing
5606Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620231225_080054__59800.0102.0210[392, 545]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080054__598.json0.0missing{\n "num_gpu": 99\n}missing
5607Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_080151__17050.056.39852[392, 269]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080151__170.json95.8333missing{\n "num_gpu": 99\n}missing
5608Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_094016__86500.0100.1440[392, 545]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094016__865.json50.0missing{\n "num_gpu": 99\n}missing
5609Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse620231227_094850__76300.012.29570[63, 475]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_094850__763.json25.0missing{\n "num_gpu": 99\n}missing
5610Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse620231227_133332__43100.08.179320[63, 319]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_133332__431.json25.0missing{\n "num_gpu": 99\n}missing
5611Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue620231227_133340__64300.07.886260[63, 308]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_133340__643.json50.0missing{\n "num_gpu": 99\n}missing
5612Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse620231227_133351__43700.010.92430[63, 424]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_133351__437.json25.0missing{\n "num_gpu": 99\n}missing
5613Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse620231227_094838__30500.09.044420[100, 344]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_094838__305.json25.0missing{\n "num_gpu": 99\n}missing
5614Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse620231227_133306__63300.08.494890[100, 323]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_133306__633.json0.0missing{\n "num_gpu": 99\n}missing
5615Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse620231227_133318__83200.012.40170[100, 470]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_133318__832.json25.0missing{\n "num_gpu": 99\n}missing
5616Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse620231227_133324__45200.05.327690[100, 200]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_133324__452.json25.0missing{\n "num_gpu": 99\n}missing
5617Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_094829__86700.07.469610[179, 142]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094829__867.json50.0missing{\n "num_gpu": 99\n}missing
5618Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231227_133237__97100.011.07590[179, 285]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133237__971.json0.0missing{\n "num_gpu": 99\n}missing
5619Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231227_133241__68000.04.424470[179, 154]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133241__680.json0.0missing{\n "num_gpu": 99\n}missing
5620Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_133257__78500.016.20880[179, 592]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133257__785.json50.0missing{\n "num_gpu": 99\n}missing
5621Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231227_094915__77200.012.91030[352, 437]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094915__772.json0.0missing{\n "num_gpu": 99\n}missing
5622Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_133424__86400.011.2840[352, 379]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133424__864.json50.0missing{\n "num_gpu": 99\n}missing
5623Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse620231227_133433__90200.08.92970[352, 295]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133433__902.json25.0missing{\n "num_gpu": 99\n}missing
5624Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_133444__70800.011.18930[352, 376]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133444__708.json50.0missing{\n "num_gpu": 99\n}missing
5625Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue620231227_094902__87910.011.83570[349, 399]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_094902__879.json54.1667missing{\n "num_gpu": 99\n}missing
5626Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse620231227_133359__27100.08.036220[349, 262]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_133359__271.json0.0missing{\n "num_gpu": 99\n}missing
5627Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse620231227_133405__49800.06.151650[349, 192]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_133405__498.json0.0missing{\n "num_gpu": 99\n}missing
5628Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue620231227_133413__60400.08.009940[349, 261]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_133413__604.json50.0missing{\n "num_gpu": 99\n}missing
5629Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTtruefalse620231214_090003__84100.015.52050[65, 461]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231214_090003__841.json25.0missingmissingmissing
5630Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTtruefalse620231225_071219__52300.013.3290[65, 394]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231225_071219__523.json25.0missing{\n "num_gpu": 99\n}missing
5631Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTfalsefalse620231225_071233__48500.013.77040[1, 422]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231225_071233__485.json0.0missing{\n "num_gpu": 99\n}missing
5632Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTtruefalse620231227_092002__78000.012.50240[65, 380]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231227_092002__780.json25.0missing{\n "num_gpu": 99\n}missing
5633Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTtruetrue620231214_085947__42600.08.250632[94, 241]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_085947__426.json75.0missingmissingmissing
5634Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTtruefalse620231225_071158__80000.09.657990[94, 280]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_071158__800.json25.0missing{\n "num_gpu": 99\n}missing
5635Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTtruefalse620231225_071206__29200.07.502020[1, 234]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_071206__292.json25.0missing{\n "num_gpu": 99\n}missing
5636Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTtruefalse620231227_091950__99700.012.97280[94, 386]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_091950__997.json25.0missing{\n "num_gpu": 99\n}missing
5637Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruefalse620231214_085939__13400.015.06280[175, 408]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085939__134.json25.0missingmissingmissing
5638Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruetrue620231225_071127__60900.024.42180[193, 420]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071127__609.json50.0missing{\n "num_gpu": 99\n}missing
5639Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruetrue620231225_071148__17500.019.16730[1, 548]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071148__175.json50.0missing{\n "num_gpu": 99\n}missing
5640Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruetrue620231227_091936__90400.022.5990[193, 441]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091936__904.json50.0missing{\n "num_gpu": 99\n}missing
5641Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTtruetrue620231214_090108__41800.027.09220[11, 718]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090108__418.json50.0missingmissingmissing
5642Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTfalsefalse620231225_071354__77600.020.42520[11, 549]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071354__776.json0.0missing{\n "num_gpu": 99\n}missing
5643Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTfalsefalse620231225_071414__24300.019.92760[1, 542]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071414__243.json0.0missing{\n "num_gpu": 99\n}missing
5644Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTfalsefalse620231227_092032__99400.02.413510[11, 66]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092032__994.json0.0missing{\n "num_gpu": 99\n}missing
5645Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTfalsefalse620231214_090041__68200.023.2560[365, 548]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_090041__682.json0.0missingmissingmissing
5646Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTfalsefalse620231225_071311__27400.015.33460[365, 337]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_071311__274.json0.0missing{\n "num_gpu": 99\n}missing
5647Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTtruefalse620231225_071334__65800.022.44620[1, 605]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_071334__658.json25.0missing{\n "num_gpu": 99\n}missing
5648Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTtruetrue620231227_092030__85020.027.64932[365, 666]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_092030__850.json83.3333missing{\n "num_gpu": 99\n}missing
5649Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231214_090941__54100.017.35662[65, 512]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231214_090941__541.json75.0missingmissingmissing
5650Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231225_073555__33800.09.560991[65, 304]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231225_073555__338.json62.5missing{\n "num_gpu": 99\n}missing
5651Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231225_073603__92600.07.140851[65, 225]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231225_073603__926.json62.5missing{\n "num_gpu": 99\n}missing
5652Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231227_092826__31230.012.3582[65, 406]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231227_092826__312.json87.5missing{\n "num_gpu": 99\n}missing
5653Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruefalse620231214_090923__97900.09.881330[94, 290]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_090923__979.json25.0missingmissingmissing
5654Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruetrue620231225_073535__60600.07.821671[104, 243]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_073535__606.json62.5missing{\n "num_gpu": 99\n}missing
5655Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruetrue620231225_073545__99900.010.00750[104, 315]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_073545__999.json50.0missing{\n "num_gpu": 99\n}missing
5656Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruetrue620231227_092814__98600.09.810630[104, 315]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_092814__986.json50.0missing{\n "num_gpu": 99\n}missing
5657Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTfalsefalse620231214_090913__63500.020.41570[175, 555]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090913__635.json0.0missingmissingmissing
5658Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTtruetrue620231225_073518__76600.016.00271[185, 289]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073518__766.json62.5missing{\n "num_gpu": 99\n}missing
5659Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTtruetrue620231225_073527__93610.09.4752[185, 283]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073527__936.json79.1667missing{\n "num_gpu": 99\n}missing
5660Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTtruetrue620231227_092804__44060.015.48522[185, 299]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092804__440.json100.0missing{\n "num_gpu": 99\n}missing
5661Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTfalsefalse620231214_091039__11300.020.70420[11, 560]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091039__113.json0.0missingmissingmissing
5662Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTtruetrue620231225_073650__98400.013.22261[368, 368]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073650__984.json62.5missing{\n "num_gpu": 99\n}missing
5663Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTtruetrue620231225_073701__63240.010.88742[368, 299]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073701__632.json91.6667missing{\n "num_gpu": 99\n}missing
5664Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTtruetrue620231227_092850__88640.010.85542[368, 301]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092850__886.json91.6667missing{\n "num_gpu": 99\n}missing
5665Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTfalsefalse620231214_091018__84500.020.30920[365, 472]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_091018__845.json0.0missingmissingmissing
5666Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTtruetrue620231225_073627__13200.013.00861[365, 362]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_073627__132.json62.5missing{\n "num_gpu": 99\n}missing
5667Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTtruetrue620231225_073636__92230.08.962522[365, 236]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_073636__922.json87.5missing{\n "num_gpu": 99\n}missing
5668Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTtruetrue620231227_092839__65200.012.97490[365, 368]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_092839__652.json50.0missing{\n "num_gpu": 99\n}missing
5669Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue620231227_183434__41200.016.0371[65, 311]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183434__412.json62.5missing{\n "num_gpu": 99\n}missing
5670Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue620231227_183454__85800.020.47491[65, 398]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183454__858.json62.5missing{\n "num_gpu": 99\n}missing
5671Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue620231227_183511__14040.016.15472[65, 313]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183511__140.json91.6667missing{\n "num_gpu": 99\n}missing
5672Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue620231227_183349__81100.011.12040[104, 209]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183349__811.json50.0missing{\n "num_gpu": 99\n}missing
5673Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue620231227_183403__11560.014.04222[104, 267]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183403__115.json100.0missing{\n "num_gpu": 99\n}missing
5674Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue620231227_183418__39360.014.69782[104, 280]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183418__393.json100.0missing{\n "num_gpu": 99\n}missing
5675Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_183310__96830.013.95982[185, 257]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_183310__968.json87.5missing{\n "num_gpu": 99\n}missing
5676Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_183321__21130.010.77312[185, 194]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_183321__211.json87.5missing{\n "num_gpu": 99\n}missing
5677Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_183337__32730.016.42862[185, 305]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_183337__327.json87.5missing{\n "num_gpu": 99\n}missing
5678Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_183624__57630.021.65352[368, 380]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183624__576.json87.5missing{\n "num_gpu": 99\n}missing
5679Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_183640__24340.016.81152[368, 288]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183640__243.json91.6667missing{\n "num_gpu": 99\n}missing
5680Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_183659__96740.018.28682[368, 316]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183659__967.json91.6667missing{\n "num_gpu": 99\n}missing
5681Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue620231227_183532__40420.021.03042[365, 368]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183532__404.json83.3333missing{\n "num_gpu": 99\n}missing
5682Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue620231227_183551__21340.018.70412[365, 324]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183551__213.json91.6667missing{\n "num_gpu": 99\n}missing
5683Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue620231227_183602__99500.011.03792[365, 177]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183602__995.json75.0missing{\n "num_gpu": 99\n}missing
5684Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse620231225_080950__64300.012.19030[61, 311]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_080950__643.json25.0missing{\n "num_gpu": 99\n}missing
5685Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_080959__16020.08.370882[61, 211]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_080959__160.json83.3333missing{\n "num_gpu": 99\n}missing
5686Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue620231227_094353__65540.09.594072[61, 242]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_094353__655.json91.6667missing{\n "num_gpu": 99\n}missing
5687Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse620231225_080928__99500.07.081540[102, 169]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080928__995.json25.0missing{\n "num_gpu": 99\n}missing
5688Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_080938__54620.09.889582[102, 242]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080938__546.json83.3333missing{\n "num_gpu": 99\n}missing
5689Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse620231227_094343__55000.08.309710[102, 200]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_094343__550.json25.0missing{\n "num_gpu": 99\n}missing
5690Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_080909__25600.023.76381[183, 428]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080909__256.json62.5missing{\n "num_gpu": 99\n}missing
5691Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_080921__50500.011.53660[183, 273]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080921__505.json50.0missing{\n "num_gpu": 99\n}missing
5692Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_094334__43300.024.47842[183, 463]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094334__433.json75.0missing{\n "num_gpu": 99\n}missing
5693Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_081045__81500.015.33860[369, 338]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081045__815.json50.0missing{\n "num_gpu": 99\n}missing
5694Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231225_081103__25200.018.16850[369, 408]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081103__252.json0.0missing{\n "num_gpu": 99\n}missing
5695Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231227_094423__54600.013.97830[369, 303]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094423__546.json0.0missing{\n "num_gpu": 99\n}missing
5696Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse620231225_081013__13900.010.04880[367, 206]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081013__139.json25.0missing{\n "num_gpu": 99\n}missing
5697Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_081029__19430.016.47722[367, 366]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081029__194.json87.5missing{\n "num_gpu": 99\n}missing
5698Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse620231227_094409__55800.016.33170[367, 361]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094409__558.json25.0missing{\n "num_gpu": 99\n}missing
5699Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005246__17000.09.955550[60, 319]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005246__170.json50.0missing{\n "num_gpu": 99\n}missing
5700Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005303__61420.016.35050[60, 523]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005303__614.json58.3333missing{\n "num_gpu": 99\n}missing
5701Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005315__10800.011.67372[60, 374]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005315__108.json75.0missing{\n "num_gpu": 99\n}missing
5702Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005326__47200.011.09851[60, 356]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005326__472.json62.5missing{\n "num_gpu": 99\n}missing
5703Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse620231228_005338__97400.011.2610[60, 361]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005338__974.json25.0missing{\n "num_gpu": 99\n}missing
5704Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005201__60700.07.520450[101, 229]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005201__607.json50.0missing{\n "num_gpu": 99\n}missing
5705Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse620231228_005207__27200.05.981510[101, 179]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005207__272.json25.0missing{\n "num_gpu": 99\n}missing
5706Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005220__47200.012.81790[101, 401]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005220__472.json50.0missing{\n "num_gpu": 99\n}missing
5707Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005227__48700.07.31741[101, 223]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005227__487.json62.5missing{\n "num_gpu": 99\n}missing
5708Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005236__65800.08.756510[101, 269]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005236__658.json50.0missing{\n "num_gpu": 99\n}missing
5709Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse620231228_005102__80800.011.39160[182, 310]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005102__808.json25.0missing{\n "num_gpu": 99\n}missing
5710Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005119__55800.016.52650[182, 501]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005119__558.json50.0missing{\n "num_gpu": 99\n}missing
5711Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005131__99900.011.89571[182, 358]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005131__999.json62.5missing{\n "num_gpu": 99\n}missing
5712Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005146__78500.014.91411[182, 453]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005146__785.json62.5missing{\n "num_gpu": 99\n}missing
5713Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005154__87100.07.588891[182, 220]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005154__871.json62.5missing{\n "num_gpu": 99\n}missing
5714Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005511__90400.012.64591[368, 345]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005511__904.json62.5missing{\n "num_gpu": 99\n}missing
5715Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005521__63000.09.669160[368, 253]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005521__630.json50.0missing{\n "num_gpu": 99\n}missing
5716Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005537__69900.016.26730[368, 456]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005537__699.json50.0missing{\n "num_gpu": 99\n}missing
5717Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005553__17200.015.99330[368, 448]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005553__172.json50.0missing{\n "num_gpu": 99\n}missing
5718Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005609__43720.015.38992[368, 430]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005609__437.json83.3333missing{\n "num_gpu": 99\n}missing
5719Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue620231228_005354__86300.016.55081[366, 465]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005354__863.json62.5missing{\n "num_gpu": 99\n}missing
5720Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse620231228_005408__62200.013.94410[366, 386]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005408__622.json25.0missing{\n "num_gpu": 99\n}missing
5721Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue620231228_005423__24600.014.46431[366, 402]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005423__246.json62.5missing{\n "num_gpu": 99\n}missing
5722Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse620231228_005441__35200.018.25810[366, 517]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005441__352.json25.0missing{\n "num_gpu": 99\n}missing
5723Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue620231228_005458__63200.016.92081[366, 476]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005458__632.json62.5missing{\n "num_gpu": 99\n}missing
5724Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse620231228_005845__66000.019.26720[60, 487]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005845__660.json0.0missing{\n "num_gpu": 99\n}missing
5725Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005900__45900.014.77231[60, 374]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005900__459.json62.5missing{\n "num_gpu": 99\n}missing
5726Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005917__70500.016.75261[60, 424]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005917__705.json62.5missing{\n "num_gpu": 99\n}missing
5727Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005940__74420.023.70662[60, 598]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005940__744.json83.3333missing{\n "num_gpu": 99\n}missing
5728Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005954__60000.013.80821[60, 349]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005954__600.json62.5missing{\n "num_gpu": 99\n}missing
5729Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse620231228_005745__27800.011.73190[101, 287]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005745__278.json25.0missing{\n "num_gpu": 99\n}missing
5730Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue620231228_005754__19700.09.856061[101, 239]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005754__197.json62.5missing{\n "num_gpu": 99\n}missing
5731Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse620231228_005808__10300.013.27070[101, 326]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005808__103.json25.0missing{\n "num_gpu": 99\n}missing
5732Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue620231228_005818__74500.010.0921[101, 245]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005818__745.json62.5missing{\n "num_gpu": 99\n}missing
5733Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue620231228_005825__70800.07.343171[101, 174]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005825__708.json62.5missing{\n "num_gpu": 99\n}missing
5734Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231228_005632__20100.022.63910[182, 518]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005632__201.json50.0missing{\n "num_gpu": 99\n}missing
5735Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620231228_005643__89700.011.28980[182, 265]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005643__897.json25.0missing{\n "num_gpu": 99\n}missing
5736Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231228_005657__41900.014.54150[182, 347]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005657__419.json0.0missing{\n "num_gpu": 99\n}missing
5737Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231228_005717__83200.019.38880[182, 468]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005717__832.json0.0missing{\n "num_gpu": 99\n}missing
5738Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231228_005733__38900.015.90330[182, 381]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005733__389.json50.0missing{\n "num_gpu": 99\n}missing
5739Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231228_010144__79400.018.77750[368, 419]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010144__794.json0.0missing{\n "num_gpu": 99\n}missing
5740Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010204__99700.020.52941[368, 462]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010204__997.json62.5missing{\n "num_gpu": 99\n}missing
5741Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010224__59530.019.91341[368, 447]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010224__595.json75.0missing{\n "num_gpu": 99\n}missing
5742Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010242__71300.017.82660[368, 396]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010242__713.json50.0missing{\n "num_gpu": 99\n}missing
5743Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010300__48900.017.34321[368, 384]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010300__489.json62.5missing{\n "num_gpu": 99\n}missing
5744Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010010__50600.015.46811[366, 338]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010010__506.json62.5missing{\n "num_gpu": 99\n}missing
5745Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010032__22800.021.8621[366, 494]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010032__228.json62.5missing{\n "num_gpu": 99\n}missing
5746Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse620231228_010051__44200.019.3450[366, 433]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010051__442.json25.0missing{\n "num_gpu": 99\n}missing
5747Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010111__89310.019.62232[366, 440]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010111__893.json79.1667missing{\n "num_gpu": 99\n}missing
5748Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010125__81720.013.59992[366, 292]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010125__817.json83.3333missing{\n "num_gpu": 99\n}missing
5749Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue620231226_124611__54800.021.51961[60, 380]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124611__548.json62.5missing{\n "num_gpu": 99\n}missing
5750Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue620231226_124635__58710.024.12132[60, 437]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124635__587.json79.1667missing{\n "num_gpu": 99\n}missing
5751Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue620231227_094735__66300.025.54071[60, 473]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_094735__663.json62.5missing{\n "num_gpu": 99\n}missing
5752Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue620231226_124531__66200.016.14851[101, 289]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124531__662.json62.5missing{\n "num_gpu": 99\n}missing
5753Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse620231226_124549__93200.018.08810[101, 316]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124549__932.json25.0missing{\n "num_gpu": 99\n}missing
5754Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue620231227_094709__10900.013.22571[101, 237]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_094709__109.json62.5missing{\n "num_gpu": 99\n}missing
5755Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse620231226_124450__59100.018.78430[182, 328]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124450__591.json25.0missing{\n "num_gpu": 99\n}missing
5756Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue620231226_124515__12300.024.87811[182, 432]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124515__123.json62.5missing{\n "num_gpu": 99\n}missing
5757Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse620231227_094656__89800.029.75090[182, 369]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094656__898.json25.0missing{\n "num_gpu": 99\n}missing
5758Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue620231226_124828__34800.021.38321[368, 354]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124828__348.json62.5missing{\n "num_gpu": 99\n}missing
5759Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue620231226_124905__90100.036.9061[368, 628]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124905__901.json62.5missing{\n "num_gpu": 99\n}missing
5760Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_094821__16820.022.18922[368, 370]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094821__168.json83.3333missing{\n "num_gpu": 99\n}missing
5761Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse620231226_124740__34300.025.55040[366, 418]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124740__343.json25.0missing{\n "num_gpu": 99\n}missing
5762Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse620231226_124806__33500.026.30050[366, 439]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124806__335.json25.0missing{\n "num_gpu": 99\n}missing
5763Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse620231227_094759__58200.024.18180[366, 406]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_094759__582.json25.0missing{\n "num_gpu": 99\n}missing
5764Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue620231227_095221__95100.058.02390[65, 343]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_095221__951.json50.0missing{\n "num_gpu": 99\n}missing
5765Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse620231227_134039__38900.028.31660[65, 162]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_134039__389.json0.0missing{\n "num_gpu": 99\n}missing
5766Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue620231227_134121__59600.041.47991[65, 243]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_134121__596.json62.5missing{\n "num_gpu": 99\n}missing
5767Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue620231227_134157__18800.036.60991[65, 213]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_134157__188.json62.5missing{\n "num_gpu": 99\n}missing
5768Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_095123__54800.050.26351[104, 290]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_095123__548.json62.5missing{\n "num_gpu": 99\n}missing
5769Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse620231227_133815__46700.026.57510[104, 146]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_133815__467.json0.0missing{\n "num_gpu": 99\n}missing
5770Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_133902__67200.046.81980[104, 270]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_133902__672.json50.0missing{\n "num_gpu": 99\n}missing
5771Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse620231227_134011__75200.068.7040[104, 402]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_134011__752.json0.0missing{\n "num_gpu": 99\n}missing
5772Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_095033__82200.077.51151[184, 298]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095033__822.json62.5missing{\n "num_gpu": 99\n}missing
5773Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_133550__91920.065.29412[184, 343]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133550__919.json83.3333missing{\n "num_gpu": 99\n}missing
5774Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_133655__93800.065.47881[184, 370]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133655__938.json62.5missing{\n "num_gpu": 99\n}missing
5775Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_133748__31900.052.76431[184, 294]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133748__319.json62.5missing{\n "num_gpu": 99\n}missing
5776Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_095447__64600.065.77571[378, 335]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095447__646.json62.5missing{\n "num_gpu": 99\n}missing
5777Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_134626__85220.045.07872[378, 212]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_134626__852.json83.3333missing{\n "num_gpu": 99\n}missing
5778Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231227_140032__98200.020.21290[378, 5]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_140032__982.json0.0missing{\n "num_gpu": 99\n}missing
5779Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_140259__86900.0146.5941[378, 769]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_140259__869.json62.5missing{\n "num_gpu": 99\n}missing
5780Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_095341__34600.079.89640[376, 418]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_095341__346.json50.0missing{\n "num_gpu": 99\n}missing
5781Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse620231227_134300__78100.061.99050[376, 314]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_134300__781.json25.0missing{\n "num_gpu": 99\n}missing
5782Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_134432__76500.092.86840[376, 494]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_134432__765.json50.0missing{\n "num_gpu": 99\n}missing
5783Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_134540__54640.067.39542[376, 344]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_134540__546.json91.6667missing{\n "num_gpu": 99\n}missing
5784Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue620231225_081227__25540.011.66572[69, 293]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_081227__255.json91.6667missing{\n "num_gpu": 99\n}missing
5785Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue620231225_081237__39430.010.03982[69, 251]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_081237__394.json87.5missing{\n "num_gpu": 99\n}missing
5786Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue620231227_094502__52600.013.04140[69, 325]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_094502__526.json50.0missing{\n "num_gpu": 99\n}missing
5787Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_081201__33000.012.04880[110, 297]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_081201__330.json50.0missing{\n "num_gpu": 99\n}missing
5788Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_081215__78120.013.65572[110, 338]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_081215__781.json83.3333missing{\n "num_gpu": 99\n}missing
5789Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_094449__27900.011.27171[110, 262]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_094449__279.json62.5missing{\n "num_gpu": 99\n}missing
5790Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620231225_081134__64000.030.20010[191, 581]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081134__640.json25.0missing{\n "num_gpu": 99\n}missing
5791Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_081149__59210.015.2212[191, 366]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081149__592.json79.1667missing{\n "num_gpu": 99\n}missing
5792Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_094437__32950.014.0972[191, 183]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094437__329.json95.8333missing{\n "num_gpu": 99\n}missing
5793Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_081343__91530.017.26082[377, 385]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081343__915.json87.5missing{\n "num_gpu": 99\n}missing
5794Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_081358__47140.014.81132[377, 324]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081358__471.json91.6667missing{\n "num_gpu": 99\n}missing
5795Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_094526__44140.011.85382[377, 249]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094526__441.json91.6667missing{\n "num_gpu": 99\n}missing
5796Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_081311__26610.013.21430[375, 285]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081311__266.json54.1667missing{\n "num_gpu": 99\n}missing
5797Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_081326__99450.014.87952[375, 326]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081326__994.json95.8333missing{\n "num_gpu": 99\n}missing
5798Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_094514__43930.012.20262[375, 257]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094514__439.json87.5missing{\n "num_gpu": 99\n}missing
5799Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruefalse620231214_090148__77200.020.10720[65, 589]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_090148__772.json25.0missingmissingmissing
5800Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231225_071514__81720.012.25692[67, 384]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_071514__817.json83.3333missing{\n "num_gpu": 99\n}missing
5801Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231225_071524__21940.09.712421[67, 304]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_071524__219.json79.1667missing{\n "num_gpu": 99\n}missing
5802Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231227_092121__91400.019.25980[67, 618]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_092121__914.json50.0missing{\n "num_gpu": 99\n}missing
5803Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse620231214_090128__59700.06.778090[94, 195]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_090128__597.json25.0missingmissingmissing
5804Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231225_071451__34600.09.771292[108, 299]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_071451__346.json75.0missing{\n "num_gpu": 99\n}missing
5805Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231225_071502__47510.011.32872[108, 349]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_071502__475.json79.1667missing{\n "num_gpu": 99\n}missing
5806Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231227_092102__59720.010.15312[108, 320]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_092102__597.json83.3333missing{\n "num_gpu": 99\n}missing
5807Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse620231214_090121__67700.012.20[175, 328]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090121__677.json0.0missingmissingmissing
5808Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse620231225_071430__18500.015.83920[189, 308]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071430__185.json25.0missing{\n "num_gpu": 99\n}missing
5809Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue620231225_071441__41710.010.35512[189, 306]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071441__417.json79.1667missing{\n "num_gpu": 99\n}missing
5810Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue620231227_092051__89800.019.03550[189, 434]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092051__898.json50.0missing{\n "num_gpu": 99\n}missing
5811Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse620231214_090220__25500.01.492270[11, 38]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090220__255.json0.0missingmissingmissing
5812Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue620231225_071646__63750.020.08252[375, 565]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071646__637.json95.8333missing{\n "num_gpu": 99\n}missing
5813Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue620231225_071657__10600.010.58120[375, 279]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071657__106.json50.0missing{\n "num_gpu": 99\n}missing
5814Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue620231227_092148__68800.013.6642[375, 383]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092148__688.json75.0missing{\n "num_gpu": 99\n}missing
5815Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse620231214_090219__81900.021.05180[365, 491]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_090219__819.json0.0missingmissingmissing
5816Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue620231225_071607__83400.016.63051[373, 462]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_071607__834.json62.5missing{\n "num_gpu": 99\n}missing
5817Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue620231225_071626__13100.019.08752[373, 537]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_071626__131.json75.0missing{\n "num_gpu": 99\n}missing
5818Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue620231227_092135__45820.013.37052[373, 374]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_092135__458.json83.3333missing{\n "num_gpu": 99\n}missing
5819Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTtruefalse620231214_091243__88200.015.56530[65, 462]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231214_091243__882.json25.0missingmissingmissing
5820Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTfalsefalse620231225_073950__10600.03.413980[68, 50]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231225_073950__106.json0.0missing{\n "num_gpu": 99\n}missing
5821Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTtruetrue620231225_074008__13860.018.42662[68, 331]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231225_074008__138.json100.0missing{\n "num_gpu": 99\n}missing
5822Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTtruetrue620231227_093025__21900.023.13591[68, 422]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231227_093025__219.json62.5missing{\n "num_gpu": 99\n}missing
5823Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTtruetrue620231214_091227__28800.07.289970[94, 211]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_091227__288.json50.0missingmissingmissing
5824Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTtruetrue620231225_073930__19710.021.60252[107, 381]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_073930__197.json79.1667missing{\n "num_gpu": 99\n}missing
5825Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTfalsefalse620231225_073946__76100.016.60540[107, 292]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_073946__761.json0.0missing{\n "num_gpu": 99\n}missing
5826Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTfalsefalse620231227_093002__19900.013.89470[107, 245]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_093002__199.json0.0missing{\n "num_gpu": 99\n}missing
5827Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTtruefalse620231214_091220__56600.012.35130[175, 332]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_091220__566.json25.0missingmissingmissing
5828Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231225_073848__12000.026.79050[188, 285]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073848__120.json0.0missing{\n "num_gpu": 99\n}missing
5829Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231225_073908__68400.019.64670[188, 331]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073908__684.json0.0missing{\n "num_gpu": 99\n}missing
5830Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231227_092948__46900.021.70380[188, 200]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092948__469.json0.0missing{\n "num_gpu": 99\n}missing
5831Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTfalsefalse620231214_091351__55800.014.04630[11, 389]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091351__558.json0.0missingmissingmissing
5832Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTtruetrue620231225_074159__13560.036.46832[371, 587]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_074159__135.json100.0missing{\n "num_gpu": 99\n}missing
5833Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTfalsefalse620231225_074205__74000.05.644470[371, 47]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_074205__740.json0.0missing{\n "num_gpu": 99\n}missing
5834Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTtruetrue620231227_093134__69200.038.40272[371, 615]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_093134__692.json75.0missing{\n "num_gpu": 99\n}missing
5835Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTtruefalse620231214_091337__23400.030.05250[365, 715]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_091337__234.json25.0missingmissingmissing
5836Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTfalsefalse620231225_074102__24500.05.596210[368, 46]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_074102__245.json0.0missing{\n "num_gpu": 99\n}missing
5837Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTfalsefalse620231225_074123__67300.020.98420[368, 323]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_074123__673.json0.0missing{\n "num_gpu": 99\n}missing
5838Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTtruetrue620231227_093056__21110.029.9972[368, 482]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_093056__211.json79.1667missing{\n "num_gpu": 99\n}missing
5839Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse620231225_081508__27800.05.283980[57, 208]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_081508__278.json0.0missing{\n "num_gpu": 99\n}missing
5840Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse620231225_081515__11000.07.245170[57, 285]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_081515__110.json0.0missing{\n "num_gpu": 99\n}missing
5841Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse620231227_094559__60200.07.9720[57, 310]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_094559__602.json0.0missing{\n "num_gpu": 99\n}missing
5842Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse620231225_081432__14400.019.36510[94, 729]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_081432__144.json0.0missing{\n "num_gpu": 99\n}missing
5843Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse620231225_081502__39000.029.85620[94, 1085]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_081502__390.json0.0missing{\n "num_gpu": 99\n}missing
5844Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse620231227_094551__99500.015.25660[94, 575]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_094551__995.json0.0missing{\n "num_gpu": 99\n}missing
5845Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231225_081409__99700.010.52710[173, 248]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081409__997.json0.0missing{\n "num_gpu": 99\n}missing
5846Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231225_081413__56100.04.533240[173, 159]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081413__561.json0.0missing{\n "num_gpu": 99\n}missing
5847Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231227_094536__88300.09.378420[173, 210]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094536__883.json0.0missing{\n "num_gpu": 99\n}missing
5848Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231225_081634__22900.011.11420[346, 376]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081634__229.json0.0missing{\n "num_gpu": 99\n}missing
5849Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231225_081635__23300.01.118850[346, 1]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081635__233.json0.0missing{\n "num_gpu": 99\n}missing
5850Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse620231227_094626__32500.015.51980[346, 529]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094626__325.json25.0missing{\n "num_gpu": 99\n}missing
5851Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse620231225_081559__35800.010.83540[343, 366]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_081559__358.json25.0missing{\n "num_gpu": 99\n}missing
5852Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse620231225_081623__95500.023.68780[343, 811]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_081623__955.json0.0missing{\n "num_gpu": 99\n}missing
5853Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse620231227_094610__58400.011.4820[343, 387]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_094610__584.json0.0missing{\n "num_gpu": 99\n}missing
5854Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruefalse620231214_091429__42900.013.7570[65, 410]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_091429__429.json25.0missingmissingmissing
5855Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruetrue620231225_074546__61610.039.58852[76, 301]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_074546__616.json79.1667missing{\n "num_gpu": 99\n}missing
5856Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruetrue620231225_074624__55020.038.33522[76, 290]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_074624__550.json83.3333missing{\n "num_gpu": 99\n}missing
5857Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruetrue620231227_093338__88430.036.56892[76, 282]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_093338__884.json87.5missing{\n "num_gpu": 99\n}missing
5858Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231214_091415__43100.010.43330[94, 306]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_091415__431.json50.0missingmissingmissing
5859Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231225_074419__95460.036.15012[115, 270]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_074419__954.json100.0missing{\n "num_gpu": 99\n}missing
5860Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231225_074506__80050.046.21492[115, 350]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_074506__800.json95.8333missing{\n "num_gpu": 99\n}missing
5861Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231227_093302__42630.030.69012[115, 229]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_093302__426.json87.5missing{\n "num_gpu": 99\n}missing
5862Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231214_091404__14800.013.29910[175, 359]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_091404__148.json50.0missingmissingmissing
5863Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231225_074254__42000.049.15831[196, 171]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_074254__420.json62.5missing{\n "num_gpu": 99\n}missing
5864Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231225_074343__39760.048.43832[196, 341]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_074343__397.json100.0missing{\n "num_gpu": 99\n}missing
5865Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231227_093231__46050.056.60442[196, 249]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_093231__460.json95.8333missing{\n "num_gpu": 99\n}missing
5866Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231214_091524__52000.018.31412[11, 500]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091524__520.json75.0missingmissingmissing
5867Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231225_075003__53630.039.09952[379, 241]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_075003__536.json87.5missing{\n "num_gpu": 99\n}missing
5868Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231225_075049__76750.045.4012[379, 289]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_075049__767.json95.8333missing{\n "num_gpu": 99\n}missing
5869Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231227_093459__95350.040.22782[379, 258]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_093459__953.json95.8333missing{\n "num_gpu": 99\n}missing
5870Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse620231214_091506__20600.023.35950[365, 550]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_091506__206.json0.0missingmissingmissing
5871Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue620231225_074822__97430.040.08882[376, 249]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_074822__974.json87.5missing{\n "num_gpu": 99\n}missing
5872Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue620231225_074923__53150.061.40462[376, 412]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_074923__531.json95.8333missing{\n "num_gpu": 99\n}missing
5873Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue620231227_093418__75120.039.85722[376, 256]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_093418__751.json83.3333missing{\n "num_gpu": 99\n}missing
5874Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue620231225_080618__30320.014.17452[69, 238]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_080618__303.json83.3333missing{\n "num_gpu": 99\n}missing
5875Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse620231225_080640__47800.022.23350[69, 378]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_080640__478.json25.0missing{\n "num_gpu": 99\n}missing
5876Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue620231227_094228__57030.027.7342[69, 471]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_094228__570.json87.5missing{\n "num_gpu": 99\n}missing
5877Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse620231225_080545__81900.019.65350[110, 327]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080545__819.json0.0missing{\n "num_gpu": 99\n}missing
5878Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_080603__86600.017.86430[110, 296]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080603__866.json50.0missing{\n "num_gpu": 99\n}missing
5879Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse620231227_094200__13200.019.73210[110, 328]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_094200__132.json25.0missing{\n "num_gpu": 99\n}missing
5880Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_080511__58300.031.32710[191, 315]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080511__583.json50.0missing{\n "num_gpu": 99\n}missing
5881Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231225_080525__14300.013.16280[191, 200]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080525__143.json0.0missing{\n "num_gpu": 99\n}missing
5882Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231227_094140__71400.027.93010[191, 306]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094140__714.json0.0missing{\n "num_gpu": 99\n}missing
5883Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_080828__19400.020.21832[377, 295]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080828__194.json75.0missing{\n "num_gpu": 99\n}missing
5884Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse620231225_080845__17300.017.03020[377, 241]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080845__173.json25.0missing{\n "num_gpu": 99\n}missing
5885Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_094310__36200.022.56460[377, 333]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094310__362.json50.0missing{\n "num_gpu": 99\n}missing
5886Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse620231225_080745__91800.028.13640[375, 426]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080745__918.json0.0missing{\n "num_gpu": 99\n}missing
5887Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_080808__15900.022.38290[375, 331]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080808__159.json50.0missing{\n "num_gpu": 99\n}missing
5888Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_094247__53500.019.32061[375, 279]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094247__535.json62.5missing{\n "num_gpu": 99\n}missing
5889Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTfalsefalse620231214_091121__50200.016.08640[65, 477]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_091121__502.json0.0missingmissingmissing
5890Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTtruefalse620231225_073733__65300.05.005420[70, 282]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_073733__653.json25.0missing{\n "num_gpu": 99\n}missing
5891Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTtruefalse620231225_073741__85600.07.459590[70, 415]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_073741__856.json25.0missing{\n "num_gpu": 99\n}missing
5892Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTtruefalse620231227_092915__42300.09.959840[70, 554]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_092915__423.json25.0missing{\n "num_gpu": 99\n}missing
5893Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruefalse620231214_091105__30000.012.36370[94, 361]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_091105__300.json25.0missingmissingmissing
5894Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruefalse620231225_073723__37500.07.038850[107, 386]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_073723__375.json25.0missing{\n "num_gpu": 99\n}missing
5895Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruetrue620231225_073728__70910.05.118380[107, 281]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_073728__709.json54.1667missing{\n "num_gpu": 99\n}missing
5896Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruefalse620231227_092905__22200.07.441190[107, 412]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_092905__222.json25.0missing{\n "num_gpu": 99\n}missing
5897Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue620231214_091052__56100.013.5250[175, 366]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_091052__561.json50.0missingmissingmissing
5898Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse620231225_073708__32500.07.135760[184, 216]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073708__325.json25.0missing{\n "num_gpu": 99\n}missing
5899Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse620231225_073716__95900.08.275530[184, 434]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073716__959.json0.0missing{\n "num_gpu": 99\n}missing
5900Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse620231227_092857__74600.06.950430[184, 225]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092857__746.json25.0missing{\n "num_gpu": 99\n}missing
5901Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse620231214_091208__38100.014.8570[11, 409]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091208__381.json25.0missingmissingmissing
5902Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse620231225_073817__63800.06.373160[357, 285]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073817__638.json0.0missing{\n "num_gpu": 99\n}missing
5903Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse620231225_073822__53100.04.519730[357, 190]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073822__531.json0.0missing{\n "num_gpu": 99\n}missing
5904Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue620231227_092927__31210.04.361260[357, 183]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092927__312.json54.1667missing{\n "num_gpu": 99\n}missing
5905Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTtruetrue620231214_091153__60300.020.06772[365, 466]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_091153__603.json75.0missingmissingmissing
5906Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTtruefalse620231225_073804__81100.09.034370[355, 421]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_073804__811.json25.0missing{\n "num_gpu": 99\n}missing
5907Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTfalsefalse620231225_073811__37000.06.923990[355, 316]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_073811__370.json0.0missing{\n "num_gpu": 99\n}missing
5908Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTfalsefalse620231227_092922__45600.07.352130[355, 339]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_092922__456.json0.0missing{\n "num_gpu": 99\n}missing
5909Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruefalse620231214_090258__56200.015.91270[65, 471]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_090258__562.json25.0missingmissingmissing
5910Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231225_071754__15710.017.26332[69, 542]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_071754__157.json79.1667missing{\n "num_gpu": 99\n}missing
5911Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231225_071806__52800.011.14522[69, 349]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_071806__528.json75.0missing{\n "num_gpu": 99\n}missing
5912Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231227_092224__21110.011.93932[69, 384]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_092224__211.json79.1667missing{\n "num_gpu": 99\n}missing
5913Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231214_090242__29900.010.94480[94, 321]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_090242__299.json50.0missingmissingmissing
5914Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231225_071730__26740.010.20442[110, 313]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_071730__267.json91.6667missing{\n "num_gpu": 99\n}missing
5915Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231225_071737__51940.07.127492[110, 214]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_071737__519.json91.6667missing{\n "num_gpu": 99\n}missing
5916Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231227_092212__32320.010.55192[110, 332]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_092212__323.json83.3333missing{\n "num_gpu": 99\n}missing
5917Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse620231214_090231__67700.011.01010[175, 294]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090231__677.json25.0missingmissingmissing
5918Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue620231225_071712__66200.014.68290[191, 262]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071712__662.json50.0missing{\n "num_gpu": 99\n}missing
5919Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue620231225_071719__57300.07.108440[191, 202]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071719__573.json50.0missing{\n "num_gpu": 99\n}missing
5920Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse620231227_092202__74300.013.33210[191, 243]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092202__743.json0.0missing{\n "num_gpu": 99\n}missing
5921Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse620231214_090358__29200.022.52140[11, 606]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090358__292.json0.0missingmissingmissing
5922Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue620231225_071903__10300.013.460[377, 366]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071903__103.json50.0missing{\n "num_gpu": 99\n}missing
5923Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue620231225_071919__30500.015.63010[377, 431]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071919__305.json50.0missing{\n "num_gpu": 99\n}missing
5924Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse620231227_092250__34900.010.62430[377, 287]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092250__349.json25.0missing{\n "num_gpu": 99\n}missing
5925Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231214_090336__71300.024.54930[365, 580]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_090336__713.json50.0missingmissingmissing
5926Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231225_071839__49400.011.81572[375, 316]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_071839__494.json75.0missing{\n "num_gpu": 99\n}missing
5927Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231225_071849__20200.09.80790[375, 255]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_071849__202.json50.0missing{\n "num_gpu": 99\n}missing
5928Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231227_092240__44130.015.06112[375, 426]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_092240__441.json87.5missing{\n "num_gpu": 99\n}missing
5929Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruefalse620231214_090449__83000.013.24380[65, 395]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_090449__830.json25.0missingmissingmissing
5930Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231225_072251__37200.060.59041[65, 447]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_072251__372.json62.5missing{\n "num_gpu": 99\n}missing
5931Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231225_072343__32800.051.44611[65, 379]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_072343__328.json62.5missing{\n "num_gpu": 99\n}missing
5932Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231227_092511__71100.059.4781[65, 449]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_092511__711.json62.5missing{\n "num_gpu": 99\n}missing
5933Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruefalse620231214_090436__21300.09.967740[94, 291]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_090436__213.json25.0missingmissingmissing
5934Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruetrue620231225_072121__11640.036.90752[104, 263]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_072121__116.json91.6667missing{\n "num_gpu": 99\n}missing
5935Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruetrue620231225_072151__26800.029.4341[104, 206]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_072151__268.json62.5missing{\n "num_gpu": 99\n}missing
5936Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruetrue620231227_092411__51210.029.07282[104, 208]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_092411__512.json79.1667missing{\n "num_gpu": 99\n}missing
5937Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue620231214_090426__40210.027.55170[175, 739]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090426__402.json54.1667missingmissingmissing
5938Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue620231225_072015__30200.055.67931[184, 203]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_072015__302.json62.5missing{\n "num_gpu": 99\n}missing
5939Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue620231225_072044__10550.028.31552[184, 186]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_072044__105.json95.8333missing{\n "num_gpu": 99\n}missing
5940Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse620231227_092342__60700.051.80430[184, 200]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092342__607.json25.0missing{\n "num_gpu": 99\n}missing
5941Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue620231214_090547__68100.020.29492[11, 549]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090547__681.json75.0missingmissingmissing
5942Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue620231225_073013__76600.081.54251[378, 528]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073013__766.json62.5missing{\n "num_gpu": 99\n}missing
5943Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse620231225_073023__25500.09.983160[378, 15]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073023__255.json0.0missing{\n "num_gpu": 99\n}missing
5944Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue620231227_092640__97800.043.19220[378, 269]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092640__978.json50.0missing{\n "num_gpu": 99\n}missing
5945Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruetrue620231214_090527__76600.025.22132[365, 596]0.4.021.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_090527__766.json75.0missingmissingmissing
5946Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruetrue620231225_072708__87300.057.20560[376, 363]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_072708__873.json50.0missing{\n "num_gpu": 99\n}missing
5947Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruetrue620231225_072851__77800.0103.2321[376, 667]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_072851__778.json62.5missing{\n "num_gpu": 99\n}missing
5948Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruefalse620231227_092557__17100.045.42910[376, 286]0.6.021.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_092557__171.json25.0missing{\n "num_gpu": 99\n}missing

Model Comparison

Highest average score by model:

fig = @chain df begin
    @by [:model] begin
        :cost = mean(:cost)
        :elapsed = mean(:elapsed_seconds)
        :score = mean(:score)
    end
    transform(_, names(_, Number) .=> ByRow(x -> round(x, digits = 1)), renamecols = false)
    @orderby -:score
    @aside local order_ = _.model
    data(_) *
    mapping(:model => sorter(order_) => "Model",
        :score => "Avg. Score (Max 100 pts)") * visual(BarPlot; bar_labels = :y, label_offset = 0)
    draw(;
        figure = (; size = (900, 600)),
        axis = (;
            limits = (nothing, nothing, 0, 100),
            xticklabelrotation = 45,
            title = "Open-Source LLM Model Performance [PRELIMINARY]"))
end
fig

Table:

output = @chain df begin
    @by [:model] begin
        :elapsed = mean(:elapsed_seconds)
        :elapsed_median = mean(:elapsed_seconds)
        :score = mean(:score)
        :score_median = median(:score)
        :count_zero_score = count(iszero, :score)
        :count_full_score = count(isone, :score)
    end
    transform(_, names(_, Number) .=> ByRow(x -> round(x, digits = 1)), renamecols = false)
    @orderby -:score
end
# markdown_table(output, String) |> clipboard
markdown_table(output)
modelelapsedelapsed_medianscorescore_mediancountzeroscorecountfullscore
magicoder:7b-s-cl-q6_K15.615.661.960.011.00.0
phind-codellama:34b-v237.137.161.272.528.00.0
magicoder12.812.853.750.041.00.0
deepseek-coder:33b-instruct-q4KM46.746.753.450.048.00.0
nous-hermes2:34b-yi-q4KM56.856.850.850.065.00.0
codellama:13b-instruct18.118.150.550.052.00.0
openhermes2.5-mistral12.912.950.450.035.00.0
starling-lm:latest13.713.750.050.027.00.0
openchat:7b-v3.5-1210-q4KM14.414.447.750.035.00.0
yi:34b-chat43.943.946.350.035.00.0
mistral:7b-instruct-v0.2-q4_012.412.445.850.052.00.0
mistral:7b-instruct-v0.2-q6_K21.721.745.750.031.00.0
mistral:7b-instruct-v0.2-q4KM15.615.644.650.047.00.0
solar:10.7b-instruct-v1-q4KM18.818.832.725.079.00.0
mistral:7b-instruct-q4KM13.913.932.325.060.00.0
llama217.117.128.325.093.00.0
orca2:13b20.120.123.80.0145.00.0
stablelm-zephyr9.99.921.325.0125.00.0
dolphin-phi:2.7b-v2.6-q6_K8.98.918.10.0154.00.0
codellama:13b-python12.512.513.80.0140.00.0
phi:2.7b-chat-v2-q6_K13.013.08.00.0197.00.0

Overview by Prompt Template

Bar chart with all OSS models and various prompt templates

fig = @chain df begin
    @by [:model, :prompt_label] begin
        :cost = mean(:cost)
        :elapsed = mean(:elapsed_seconds)
        :score = mean(:score)
        :score_median = median(:score)
        :cnt = $nrow
    end
    @aside local average_ = @by(_, :model, :avg=mean(:score)) |>
                            x -> @orderby(x, -:avg).model
    data(_) *
    mapping(:model => sorter(average_) => "Model",
        :score => "Avg. Score (Max 100 pts)",
        color = :prompt_label => "Prompts",
        dodge = :prompt_label) * visual(BarPlot)
    draw(; figure = (size = (900, 600),),
        axis = (xticklabelrotation = 45, title = "Comparison for OSS Models [PRELIMINARY]"),
        legend = (; position = :bottom))
end
SAVE_PLOTS && save("assets/model-prompt-comparison-oss.png", fig)
fig

Table:

output = @chain df begin
    @by [:model, :prompt_label] begin
        :cost = mean(:cost)
        :elapsed = mean(:elapsed_seconds)
        :score = mean(:score)
    end
    @aside average_ = @by _ :model :AverageScore=mean(:score) |> x -> round(x, digits = 1)
    unstack(:model, :prompt_label, :score; fill = 0.0)
    transform(_, names(_, Number) .=> ByRow(x -> round(x, digits = 1)), renamecols = false)
    leftjoin(average_, on = :model)
    @orderby -:AverageScore
end
# markdown_table(output, String) |> clipboard
markdown_table(output)
modelInJuliaJuliaExpertAskJuliaExpertCoTTaskJuliaRecapCoTTaskJuliaRecapTaskAverageScore
magicoder:7b-s-cl-q6_K63.361.854.562.667.461.9
phind-codellama:34b-v260.669.759.159.157.861.2
magicoder59.651.046.457.054.553.7
deepseek-coder:33b-instruct-q4KM58.939.848.761.658.153.4
nous-hermes2:34b-yi-q4KM58.837.752.846.258.850.8
codellama:13b-instruct55.551.845.647.951.750.5
openhermes2.5-mistral50.352.354.642.252.650.4
starling-lm:latest53.657.938.246.953.550.0
openchat:7b-v3.5-1210-q4KM49.847.844.347.649.147.7
yi:34b-chat46.152.441.142.949.146.3
mistral:7b-instruct-v0.2-q4_050.341.445.645.645.945.8
mistral:7b-instruct-v0.2-q6_K42.639.848.148.849.345.7
mistral:7b-instruct-v0.2-q4KM41.049.341.443.847.544.6
solar:10.7b-instruct-v1-q4KM42.036.017.632.535.832.8
mistral:7b-instruct-q4KM34.731.631.331.632.332.3
llama226.133.029.728.424.128.3
orca2:13b28.116.927.323.723.223.8
stablelm-zephyr22.017.818.822.225.821.3
dolphin-phi:2.7b-v2.6-q6_K22.318.314.916.318.618.1
codellama:13b-python11.414.415.113.014.913.8
phi:2.7b-chat-v2-q6_K7.36.56.89.210.28.0

Other Considerations

Comparison of Time-to-generate vs Average Score

fig = @chain df begin
    @aside local xlims = quantile(df.elapsed_seconds, [0.01, 0.99])
    @by [:model, :prompt_label] begin
        :elapsed = mean(:elapsed_seconds)
        :elapsed_median = median(:elapsed_seconds)
        :score = mean(:score)
        :score_median = median(:score)
        :cnt = $nrow
    end
    data(_) * mapping(:elapsed => "Avg. Elapsed Time (s)",
        :score => "Avg. Score (Max 100 pts)",
        color = :model => "Model")
    draw(; figure = (size = (800, 800),),
        axis = (xticklabelrotation = 45,
            title = "Elapsed Time vs Score for Paid APIs [PRELIMINARY]",
            limits = (xlims..., nothing, nothing)),
        palettes = (; color = Makie.ColorSchemes.tab20.colors))
end
SAVE_PLOTS && save("assets/elapsed-vs-score-scatter-paid.png", fig)
fig

This page was generated using Literate.jl.